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ABSTRACT 


This thesis is concerned with computer modelling 
Of natural language. Some recent natural language 
models are reviewed; anda particular model, Quillian's 
(1969) Teachable Language Comprehender, is examined in 
Getat Weel hee tiesisathen preposes MUSE, a natural 
language processor that uses both syntactic and semantic 
techniques to understand simple English input. MUSE 
CanesactL upon dts Understanding of the input and can use 
this understanding to increase its "knowledge of the 
world" (stored in a highly interconnected memory network). 
MUSE's theory and implementation are thoroughly discussed, 


and an evaluation of the model is given. 
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CHA RATER TE 
NATURAL LANGUAGE MODELLING 


LALEOCUCELLON 


This thesis is about the study of language using 
simplified linquistic models. Major emphasis is placed 
on computer models, especially those which deal heavily 
with semantic processing. Eventually an original natural 
language computer model is proposed which understands 
Simplified written English input and acts upon it in an 
appropriate manner. It is called MUSE, a Model to Under- 
stand Simple English. Before MUSE can be fully understood, 
however, a closer examination of natural language modell- 
ing is needed. 

Man has been curious about language ever since he 
first began to communicate. Scholars have studied the 
structure of language from at least the time of the 
Greeks, when the first understanding of the role of parts 
of speech began to emerge. Knowledge of language has 
developed steadily since then, culminating in the sophis- 
ticated memory networks and transformational grammars of 
Coed) eileeucieMOLomsLMieeiase tO be learned Derore any 


language can be fully understood. 
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Notvoniy 1s the study of language important.in its 
own right, but it also gives great insight .into many 
closely related disciplines, prime among them psychology. 
When using language, people translate it into some sort 
of cognitive structure. Thus, a knowledge of language 
should give the psychologist or psychiatrist some insights 
‘into the processes taking place behind the words. A 
thorough knowledge of language would also enable many 
useful things to be implemented, among them mechanical 
translation between different languages, natural language 
programming of computers, context sensitive information 
retrieval systems, and meaningful question answering and 
problem solving machines. 

Natural language is generally considered to consist 
of three components: syntax, semantics, and phonology. 
The syntactic component is concerned with the "principles 
for combining words to form grammatical sentences" 
(ReangacweG, 6196/7 ,spadgemlUjeathateis,how wordssare yrelated 
to each other in a sentence. Syntactic analysis of a 
sentence often calls for the sentence to be "parsed" into 
a tree structure representing the connections of words in 
thessentence to each other. This is usually accomplished 
bes melas cOUMaltione- Uleceon, thewparts orespeech of 


the words in the sentence. 
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Semana csr issthemstudy. of meanings. that? ds) how 
words are related to the speaker's "knowledge of the 
world". Thus, a semantic analysis of a sentence would 
involve associating the words in the sentence with their 
meanings. 

Finally, the phonological component of natural 
language deals with phonetics, the sound sequences 
emitted when speaking words in a sentence. This thesis 
will not be concerned with the phonological part of 
language, but solely concerned with written English 
(from now on the terms "natural language" and "language" 
will usually refer to written English). 

Of course, the three component structure is grossly 
oversimplified. The border between all three groups is 
not well defined, and even within each group there are 
Many as yet unresolved difficulties. Among the most 
troublesome problems are ambiguities. These can be 
syntactic, where there is more than one possible gram- 
matical analysis for the sentence; or semantic, where 
there are several valid interpretations of the meanings 
of the words in the sentence. A good deal of research 
in modern linguistics is concerned with explaining 


ambiguity. 
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Because of ‘the ‘complexity of language, simplifying 
assumptions are often required in attempts to model 
natural language. Many natural language models have 
been developed to consider aspects of syntax and semantics, 
and these are often tested by being implemented as compu- 
ter models. Computer modelling enables a preciseness of 
thought seldom before achievable. The development of 
symbol oriented list processing and string manipulation 
languages (such as LISP or SNOBOL) for the computer has 
hastened even further the swing towards programming 


computer models of language. 


Components of a Linguistic Model 


Before a computer model can be implemented numerous 
problems must be examined and solved. The modeller must 
decide on the particular aspect of language he wants to 
simulate, and he must have some specific problem area to 
constitute the "universe of discourse" for the model. 

He needs to devise a memory structure in which to store 
the model's "knowledge of the world". He must decide 
CheVsore of restrictions towimpose on the input to ‘the 
model, and how this input is to be interpreted by the 
model. The modeller must choose what is to be produced 
aomoue Cee Cone tie’ MOdcl-smeand = Lt ethe systemers eto be 


of much generality, he must devise ways of increasing 
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and modifying the model's memory and procedures. Finally, 
he must choose an effective method for testing his model. 
Each of these problems is described below, along with 


some of the diverse solutions which have been devised. 


General Problem Areas for the Model 


The first thing the researcher must do is decide 
the general problem area in which he wants to build a 
model. There are several areas of research where natural 
language plays an important role, question answering and 
fact retrieval being perhaps the most widespread. Such 
systems usually consist of a highly structured data base 
whichcontains -informationgabout, some limited project. 
Answers to questions are derived from this data base 
using some set of procedures. Usually it would be very 
convenient to be able to ask questions in natural language 
and get natural language responses. Simmons (1970) out- 
lines a reasonably complete survey of recent efforts in 
thisef.e1d., 

The second major area for research is problem 
solving. Closely related to question answering, problem 
solving usually involves more emphasis on mathematical 
procedures and less stress on deducing answers from a 
datas bascwm elu swoUuldastilie besattractive, however, to 


bewable to state the problem in natural language. 
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Bobrow (1968) and Charniak (1969) solve algebra and 
calculus word problems stated in relatively normal 
English. 

Psychological modelling is another field where 
natural language processing plays a large role. The 
idea here is to simulate the cognitive processes 
underlying behavior with some sort of highly inter- 
connected memory net. Programming the model to 
process natural language input and produce natural 
language output aids in discovering important principles 
CtepsVciolegy . "CO yedia omben (L960)e= "Colby, Tesler, 
and Enea (1969); and Abelson and Reich (1969) have 
produced papers which describe the latest versions of 
a long line of "human belief system" models. 

Finally, natural language models are built to 
help in the study of language itself. Models have 
been devised that handle many aspects of syntax and 
semantics. Transformational grammers have been 
programmed (Dewar, Bratley, and Thorne, 1969; 

Friedman, 1969) and semantic memory systems devised 
(Quillian, 1969). Combinations of these have been 
implemented by Schank, Tesler, and Weber (1970) and 
Schwarz, Burger, and Simmons (1970). Competence models 


Or wanguistics Rave Deens=proposed (Katz and Postal, 1964; 
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Chomsky, 1965), “but these -are™not strictly relevant to 
the performance models emphasized in this thesis. 

Most of the above areas overlap and most models 
have been devised with more than one problem area in 
Mind. For example Quillian (1969) describes a model 
limited mostly to developing a semantic memory net, but 
he calls it a "psychological theory" and outlines ideas 


for incorporating new features to improve his system. 


Speci LCeouby CCUsmLeOmoeenand ed sbyethe Model 


During the discussion of the general areas of 
research, the problem of specific subject areas has 
already been touched upon. Once the researcher has 
decided on his general interest (or interests) he usually 
chooses some smaller topic to form the data base for his 
system. Aside from the algebra and calculus word problems 
and human belief systems already mentioned, there are many 
other subjects which have been explored. Weizenbaum 
(1966) developed ELIZA, a conversation machine programmed 
to simulate a psychiatric interview; and Becker (1969) 
has devised a method to handle analogy and induction. 
Systems have been developed to solve problems about 
Geomecrice Lelacronsiivomnepitetures (Coles), #1969) ‘—Kochen 
Te ene  pLOCUCce@OuLoUCe On clit linesrigateschedules 


(Woods, 1968). Question answering systems respond to 
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queries on varying subjects including survey data on 
PaRqe.U- Ss mcibiess(kellogap7egh969).,, military supply 
problems (Craig, Berezner, Carney, and Longyear, 1966), 
kinship relations (Lindsay, 1963; Shapiro and Woodmansee, 
1969), baseball schedules (B.F. Green, Wolf, Chomsky, 
andselaughery ..1963),, andichildren's stories -(Tharp and 
Krulee, 1969). In addition many natural language models 
handle a variety of self contained problems. Thus, 
Raphael's (1968) SIR can handle any problem whose basic 


postulates have been fed to the system. 


Memory Structure of the Model 


Once the researcher has defined what subject will 
form his model's "knowledge of the world", he must 
design a memory system in which to store this knowledge. 
Two main types of memory have been employed: the pro- 
cedure oriented memory and the network oriented memory. 

The procedure oriented memory systems rely on rules 
tOecacey Che burden of sincerpretation and so are them- 
selves relatively unstructured. Classical linguistic 
analysis depends on just this sort of approach. The 
Memory consists of a lexicon (or dictionary) containing 
valid words and corresponding syntactic and semantic 
markers. A separate set of "rewrite" rules for handling 


these words is defined as well. Rosenbaum (1967) proposes 
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such a system. Woods (1968), Kellogg (1968), Kochen 
(1969), and Weizenbaum (1966) have designed procedure 
oriented models which differ from the linguistic models 
only because the rules for handling the lexicon are not 
separate from the lexicon. Instead, each word in the 
dictionary can have! pointers’ to various procedures *to 
be executed when that word is encountered. 

The network oriented systems generally define a 
much more sophisticated memory structure, usually 
COMprrseceometwo pales:  amdictionaryeandea network. 

The dictionary contains the natural language words 

(and corresponding markers of various types) which the 
system recognizes. The network is an interrelated structure 
representing concepts and relations in the system and 
consisting of nodes and links connecting the nodes. 

Pointers extend from words in the dictionary to nodes 

in the network. 

Many early natural language processors such as 
DAShGh Vie Gel Cleenmotmcisn, = 1963) and SAD-oAM (lindsay , 
1963) restrict the network to tree structuresof one-way 
unlabelled links. This was followed by a trend towards 
ring structures which are two way links allowing the 
memory to be defined in a highly recursive manner. 
DEACOUN@NGLaig Gl lala, lO6) 1S One SUC System. “Recent 


efforts have not only allowed the links to branch 
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recursively back into the network, but have also labelled 
the links, thus enabling very complex, nested relational 
sentences to be properly interpreted. Some good examples 
of such systems are Shapiro and Woodmansee's (1969) 
SAMENLAQ II, PROTOSYNTHEX III by Schwarz et al. (1970), 
Orta ce( 1969) ThCeandecrINOZAst iby schank™et “ale 

UVLO Oye I nesbeller system Oorecolby and Somith= (1969) and 
Colby, Tesler, and Enea (1969), and Becker's (1969) model 
gometi ll a step tuntier by welgiting each™link™ain= the 


memory according to its "importance" to the system. 


Input to the Model 


Defining the input for a natural language model is 
far from being.an easy task. Not only are an unlimited 
number of grammatical sentences possible in any language, 
but the definition of grammatical itself varies according 
to the dialect under consideration. In addition computer 
modelling necessitates numerous simplifying assumptions 
so that space and time constraints can be satisfied. 
Clearly, some restrictions must be imposed on the input. 

Natural language models so far devised seem to fall 
into several categories of restricted input. The most 
rigid systems are those which use a completely artificial 


language to avoid the vagaries of natural language. One 
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such is the QA3 system devised by C. Green (1969) which 
uses, the predicate scalculus.as input. 

Input is sometimes restricted to handling only 
Simple sentences. Hence, SAMENLAQ II (Shapiro and 
Woodmansee, 1969) and Abelson and Reich's (1969) belief 
system both assume simple "X relation Y" sentence input. 
Closely related are the systems which employ a para- 
digmatic approach, i.e. use fill-in-the-blank sentence 
types where the blanks are variables to be replaced by 
WOLOS wae liUS, Su woeo Sebelomc Sentence @Lonmelomiequiyalence, 
X and Y being the variables standing for words. Raphael's 
(969) 00S  Reeebobrowssi 60960 ees TUDENT = Charnrakivs: (969) 
CARES wands Colby and Smithyse( 1969) ABSigal lsthavesres= 
CGLGULONS: Ofsthis. typcsonmchaecwinput. 

Another way of reducing input complications is to 
restrict the input to sentences on a specific topic. 

These systems often work on a "keyword" principle which 
makes a wide variety of sentences possible as long as 

the subject matter remains constant. Good operation of 
the ELIZA (Weizenbaum, 1966), BASEBALL (B.F. Green et al., 
1963), and SAD-SAM (Lindsay, 1963) systems depends on 
thewinpuc being ’on*a Tamited™ topic. 

When a truly far reaching natural language model 
is desired, however, such "patchwork" methods are not 


sufficient, and a more general scheme is required. 
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UstaFivethts 1nvolves defining avsetnof rules to’ apply 
to the input to reduce it to some convenient form. 
Traditionally these rules have been formally defined 
generative and transformational rewrite rules. Thus, 
the input to the question answering system of Tharp and 
Krulee (1969), and Kochen's (1969) diagram processor must 
be "parseable" English sentences. 

Finally, there are the models which claim to have 
unrestricted input, in principle. These models do not 
tend to have rewrite rules as rigidly defined as those 
of transformational grammars. Whenever a new sentence 
does not fit the existing structures, new rules are 
defined to handle these cases. Of course, any working 
system will not be complete and will have many sentences 
which are not understandable to that particular version. 
Recent systems along these lines are SPINOZA II (Schank 
etal i970)e PROTOSYNTHEX LI! (Schwarzwettadey 1970), 


and bem (Oul! mane L969)e 


PiterypLeting thes input 


The most important aspect of any natural language 
Pueacec comers WOWuLteinLeLpretc wits oanput.. Clearly there 
is a need for the system to in some sense "understand" 

Sa eliplussentence., wlhissinvolves translating the sentence 


into a form which the model has been equipped to handle. 
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Interpreting the input breaks down into three interwoven 
subprocesses: syntactic processing, semantic processing, 
and deductive processing. It is impossible to truly 
separate these entities from each other, but a separate 
analysis does give some insights into their relationship 
to natural language processing and to each other. 
Syntactic processing usually involves discovering 
which words in a sentence are related to each other, 
and in a limited sense how they are related. It is the 
job of any model's syntactic element to weed out inter- 
pretations of a sentence which are not "grammatical". 
The easy way to do this is to restrict input to sentences 
that by definition are grammatical and need little or no 
syntactic processing to be understood by the model. 
tii ees tne, Case with models that limit input to ’an 
SLulriclamelanguage, stO-simple sentences, or to form 
sentences (see the previous section for examples). 
Another common method of syntactic analysis is to 
use phrase structure or transformational grammars to 
produce trees which represent the syntactic connections 
possible in a sentence. Many computer programs have 
been written to produce syntactic trees (although most 
of them handle only restricted English input), and some 


of them are used in natural language processors.devised by 
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Beem Groeneot edi | ob5) , Woods (1968), Kellogg (1968), 
Coles ml ooo) louanpmand hi lee @(1969) Lindsay. (1963), 
ands Kochen 9(1969). 

Sometimes the syntax portion of a model is merged 
with other elements, and syntactic analysis is a by- 
product of the application of rules which can be both 
Syntactic and semantic. PROTOSYNTHEX III (Schwarz eli le, 
1970)) and SPINOZA IT (Schank et al., 1970) both exemplify 
what seems to be a growing trend away from separate 
syntactic and semantic analyses. 

Semantic processing of language becomes necessary 
when there is more than one syntactic analysis (syntactic 
ambiguity), or when words in the sentence have more than 
one meaning (Semantic or contextual ambiguity). Semantics 
is not nearly as well researched a field as is syntax. 
The study of meaning has been in confusion for years, and 
in the past semantic processing most often consisted only 
of attaching semantic markers to words to enable better 
syntactic processing. Today there is renewed interest 
in meaning, and almost all recent computer models employ 
some reasonably sophisticated techniques for semantic 
processing. 

Just as syntactic processing aims to keep only 
grammatical interpretations of the input, semantic 


analysis attempts to retain only "semantically well-formed" 
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(Simmons, 1970, page 26) renditions. The test for 
semantic well-formedness is the basis for any semantic 
interpretation procedure. When the semantic procedures 
of a system are invoked, there are generally many inter- 
pretations possible for the input, resulting from 
SVMLAGELCH Or Semantic! ambiguityrestThei job! of theisemantic 
component is to use the meanings of the words in the 
input to resolve these ambiguities as much as possible. 
Semantic analysis generally takes one of three forms,depending 
on what kind of memory structure the particular system 
has. 

Procedure oriented systems usually translate the 
input into some set of procedures. If the execution of 
these procedures fails, or if the rules for translating 
the input into the procedures in the first place operate 
unsuccessfully, a new interpretation is tried. An 
executing output procedure constitutes. a valid test 
for semantic well-formedness. Indeed, the models of 
Woodsen. 963)75 Kellogg, (1963) ,sandekochen (1969), dovalmost 
exactivs this: je€oles~i(1969). ssystemareduces the input via 
SpLOUUCEIONarules:, tothe predicate, calculus which is 
Tes ledmron a truth value;sewand C. Green's, (1969) QA3 
uses automatic theorem proving techniques to discover 
the validity of the input. 

The second semantic method is exactly the same as 


the previous method, only the output is not executable. 
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Thus, if the semantic transformation rules succeed on 
some interpretation of the input, then that interpre- 
tation is semantically well-formed. All interpretations 
which survive the application of these rules are valid; 
that is,no further processing is carried out to eliminate 
the remaining possibilities. Rosenbaum (1967) proposes 
amsystem*tsuch-as ‘this: 

The third semantic procedure works for network 
oriented meno aa It involves transforming the input 
into memory structure terminology and then searching 
through the memory net, via some intersection technique, 
for previously defined concepts which are closely related 
to the input. Since the system "knows" all items in its 
memory, this procedure is equivalent to the system 
understanding how the input relates to its “knowledge 
of the world". A valid intersection thus constitutes a 
test) £o0r semantic. welll-Lormedness. “TLC” (Quiliian, 1969); 
PROTOSYNTHEX III (Schwarz Simciee 7m lo 0) aor INOS ASI 
focud ihc tacit. jes) Uji meiomcic belle: mocdelssof. Colby 
anoeomlcn L969); = COLOwemelLes tor, and Knea (1969); “and 
Abelson and Reich (1969) use this system or variants of 
oe bate 

Dbeaquetive Procccamig~s alSO an important part of 
COEreCt ly, InterpLetingehatural input. “To engage intel- 


ligently in natural language conversation, a well 
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developedelogical’ ability, isyessential.- It is required 

if the system is to give correct answers to questions, 
perform deductions on input, or perform any manner of 
logical inference. Very few models have separate, 

clearly defined logical procedures. The models of 

Coles (1969) and C. Green (1969) have the most explicit 
logical techniques, transforming input into the predicate 
calculus. Most memory net models have subset, superset, 
equivalence, and implication relations defined as possible 
links between nodes and thus have quite a logical basis. 
Procedure oriented systems have some logical capabilities 
imbedded in their rules, but do not generally have obvious 


deductive ability. 


Output From the Model 


After the model has processed its input, it should 
make some response, preferably one appropriate to the 
input. Many systems attempt to reply in natural language, 
but some produce other types of output. 

Tihesleast Naturalsoutput ist@a memory Structure 
Bespolise,) that sis OuLbDUteIn the model Vs internal repre- 
sentation. This response format requires very little 
BACMeLOna Le DLOCes SilGmanoenence usa popular one. It 
also enables a person who knows the intricacies of the 


model to more fully understand its workings. BASEBALL 
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(B.F. Green et al., 1963), SAD-SAM (Lindsay, 1963), and 
SPINOZA PL Ue(Schankwetvals, #1970). respond ywith memory- 
Vike list structures. C.. iGreen (1969) has his system 
produce output in the form of the predicate calculus. 

Procedure oriented systems most often produce a 
procedure rather than a natural language response. In 
fact Kellogg's (1968) CONVERSE is the only system which 
actually executes its procedures to yield a natural 
language answer. Woods' (1968) model produces a state- 
Ment in a"query" language, and Kochen's (1969) system 
S€tcuupra flow chante Or a procedure. 

Any system trying to produce natural language 
responses is subject, of course, to the same type of 
PeseroMieomelaceneste 1 Cemnarural slanguage onNpuc. lilo, 
ELIZA (Weizenbaum, 1966) and SIR (Raphael, 1968) yield 
natural output using paradigmatic form sentences. TLC 
(OQuillian, 1969) also responds with paradigmatic Sentence 
output but produces a memory structure format as well. 
SAMENLAQ II (Shapiro and Woodmansee, 1969) answers 
questions in simple relational sentences. CARPS (Charniak, 
1969) and STUDENT (Bobrow, 1968) respond in single word 
or short phrase answers which are almost natural, but 
are too short to have much structure. A small generative 


grammar generates limited natural output for Coles' (1969) 
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system, and a sentence generator has been defined in 
PROTOSYN@HESS Ti (Schwarz "et ‘al. ,* 1970)’ which gives 
Simple English output. It is reasonable to assume that 
more sophisticated output techniques will soon be 
forthcoming to replace the somewhat crude systems that 


ane’ generally in’ operation today. 


Expanding the Model 


Once a natural language model is running smoothly, 
the researcher inevitably becomes bored and wants to 
expand its scope. This could involve expanding proce- 
dures, increasing memory size and complexity, or changing 
any number of other items. Ideally the model should be 
able to extend itself and should have general facility 
in modifying many of its components. This is seldom the 
case. 

Furthest from the ideal are systems which must be 
manually extended. In these models new words, markers, 
relations,. and procedures must all be added by hand, so 
the system can be expanded only with great difficulty. 
Thusmteaubem:S spabeuculamly echaracteristic .of many of 
Chemod Gl Veco lems eoUChmace DAGEDALIA (BF Green etyaliy 
1963), STUDENT (Bobrow, 1968), and ELIZA (Weizenbaum, 
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A more recent approach is to define the model in 
such a manner that it can extend its own universe. 
DEACON (Cralgqectpal a l900)sand STR (Raphael, 1968) 
are set up to derive new relations from on-line 
Mesos. although new words must be manually added. 
CONVERSE (Kellogg, 1968) also adds new relations 
automatically and, in addition, recognizes new words 
if they are underlined. Finally there are the systems 
which understand both new relations and new words from 
input text without any special markings. Quillian 
(1969) accomplishes this, for example, by assuming all 
words input to TLC are new in some sense. SPINOZA II 
(scirenk we ural #097 0)e recognizes valli wordsiinotminelts 
dictionary and sets up new space for them. SAMENLAQ II 
(Shapiro and Woodmansee, 1969) not only learns from 
dialogue but can also generalize from examples fed to 
it. Becker's (1969) model derives new concepts by finding 
analogies tothe tinputys and! Colby and “Smith's (1969) 
ABS1 asks guestions of the user, the answers to which 
help the system to modify its values. The models of 
Becker 61969) mand (Colby e@and ySmith 6 (1969)ealso can dynami- 
cally reassign weights to memory links to help the system 


téeampneor lorget : 


Testing the Model 


Once the model has been fully defined, some method 
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of ascertaining its abilities must be sought. This 
usually takes the form of programming a computer 
Simulation of the model, although some models, such 

as that of Becker (1969), have not been fully transferred 
to the computer as yet. The programming languages used 
are invariably symbol manipulation languages such as 


TPs Vi7PLISk, eon, SNOBOL. 


Conclusion 


From the foregoing analysis five major classes of 
model can be delineated. First, there are the compe- 
tence models of Katz and Postal (1964) and Chomsky 
(1965) which are more concerned with explaining language 
than with modelling it. Then there are the procedure 
oriented models (Woods, 1968; Kellogg, 1968; Kochen, 1969) 
which reduce their input to procedures which can be 
examined or executed to determine semantic well-formedness. 
Models of the third type are based strongly on logic 
theory. They usually reduce input to an expression in 
the predicate calculus from which a truth value can be 
calculated and, if necessary, theorem proving techniques 
applied. Coles (1969) and C. Green (1969) have designed 
such systems. The fourth type of model is distinguished 
Mainly by depending on a limited relational memory. 


Concepts are usually represented in this memory by 
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straightforward list structures consisting of words 
and simple relations between the words, where these 
relations are often semantic primitives defined as 
programmed subroutines. Many early systems work in 
this manner including SAD-SAM (Lindsay, 1963), BASE- 
Beige oe ceeG ecUect ed Wale est Re (Raphael, 1968), 
STUDENT (Bobrow, 1968), and ELIZA (Weizenbaum, 1966). 
Models in the fifth class are the direct successors 
to those in the fourth and often have much the same sort 
of design. AS in fourth category models, concepts are 
represented in memories consisting of words and links, 
and procedures are used to translate input into memory. 
theiw main differences Jie in the sophistication of their 
memory structures (which are often highly nested), the 
uniformity of their methods for determining semantic 
well-formedness (often through intersection techniques), 
and the generality of input and subject matter which 
they allow. Examples of models belonging to the fifth 
Glass are those devised by Craig et al. (1966), Shapiro 
and Woodmansee (1969), Colby and Smith (1969), Abelson 
aie e cme (06 epmrectomm@o69)), schanktet aly (1970), 
Schwarz et al. ClO OP meanomoud lUllan  (L9GO) Out tan Ss 
PiGelesDaGiicullariy simponrtant Since much or MUSE is based 
GuLectly son eit. Saennes ies devotedmtomda, thorough 
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CHAPTER 1. 
THE TEACHABLE LANGUAGE COMPREHENDER 


Mecrogquction 


This chapter presents a detailed analysis of a 
recent natural language model - Quillian's Teachable 
Language Comprehender (TLC) (Quillian, 1969). This 
is undertaken in the hope that the study of the workings 
ChedgDdn tr culammoceimwi) lehelpeco, furciens llustrate 
some of the problems associated with natural language 
modelling. TLC has been specifically chosen since 
understanding MUSE depends on understanding TLC. 

TLC is the latest version in a long series of 
models, devised by M. Ross Quillian, which rely heavily 
Opmsemanty Ceprocessingms (Oullizvan, 1966, 1967, 1963)". 

Tt is a computer model (programmed in BBN-LISP) that 
is designed to comprehend natural input, to learn from 
on-line discourse, and to respond with natural language 


output. The basis forg’LG is,its semantic memory. 


The Memory Structure OLee TGC 


TLC's semantic memory is a completely abstract 
network of units and properties. Each unit in the 
memory represents some concept which the system under- 


stands; and, although many units are linked to English 


ad 
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words in a dictionary, no unit necessarily has to corres- 
DONUMCO aegis wor em CraCied stowa Unit 1Sea pointer 
LOepanOcner Unity: tiseslperse:, and possibly pointers to 

a number of subproperties. These properties modify the 
Superset in such a manner as to correctly code the concept 
that the unit represents. 

A property 1s an attribute-value pair symbolizing 
aupredicate to the systems, "ihe notion of attribute-— 
value has been expanded to include preposition-object 
(Erg es dOWnestrect, ) andyverb-coyect (e.g. 8 Chase Car’), 
as well as the traditional meaning of the term (e.g. 
“speed fast"). Each property has pointers to units 
representing its attribute and value and, if needed, 
pointers to further subproperties modifying the original 
PLOperLy. “olnce each’ subproperty scan Nave furtherm sub-— 
BropeLttes, erbrturari ly ecomplem™ predicates) Can be 
represented in the system. Also appended to each property 
See DO ter LO.c Serr OummBOlmetres ts eto sabes Uusecdsin tie 
SV itpaetl orp rOCesoa (1) fC meuiem I nol Tieses_Ormeteotsydl.e 
not part of the semantic memory, so they will not be 
explained in further detail at this point. In addition, 
Quillian indicates that the memory format provides for 
the quantification of units and for the grouping of ‘units 
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For example, a dog named Ruff who chases cars 


could be represented as shown in Figure 2.1. The square 


Dictionary entry 


Rune 


ve a) 


Paes 


CHASEL CARY 


Figure 2.1 The memory concept for RUFF1 


brackets represent units, the round brackets are proper- 
ties, the capitalized words are dictionary entries. 

The numbers after the words represent the particular 
meaning involved (e.g. there might be another meaning 
POtehUL eCal TCOmRUME Zn) spanagoOsnOtl exist in tie  dactud | 
Memory. In the example above, Ruff is the dictionary 
entry for the corresponding unit RUFF1 in memory. From 
now on, pointers to units and words will be represented 
by their English equivalents in the above notation. It 
can be seen from Figure 2.1 that the word Ruff is entered 
TieomGLocLOlaly andwlsmualnked tO a Unit in memory 


(RUFFL). This unit has the superset DOGI1 and a subproperty 
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consisting of attribute CHASE] and value CARI] with no 
further subproperties. The property (CHASE] CAR1) 
modifies the superset DOG1 to yield the memory's concept 


Of) RUPF 1: 


Interpreting the Input to TLC 


The system comprehends English input (which is 
unrestricted, in principle) by translating the input 
into an appropriate coding in memory format which can 
then be added to the memory. In this manner the model 
understands the input, and at the same time builds up 
its "knowledge of the world". Syntactic, semantic, and 
logical processing are all combined in this single 
interpretation process. 

Before proceeding further, an example is given 
which will aid in understanding the way that the model 
works. Assume that the definition of RUFF1 above is 
coded in memory, and the sentence "Ruff chases Volks- 
wagen" is read into the system using the command READ 
(RUFF CHASE S VOLKSWAGEN). The single letter "S", 
written seéparately.in the input, is the present tense 
Siig Lote cio verb CHAGhOmeAl  eSuLrixes in. LC are 
written separately so that the model can avoid the 
necessity of complicated syntactic processing to discover 


Toetawords. | Thesinputeis taken to be a completely new 
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concept, at least for the present,and new empty units 
are set up to represent the new meanings of Ruff, Chase, 
and Volkswagen. To avoid confusion these empty units 
will be called ul, u2, and u3 respectively. The job of 
TLC is to associate with each ul, u2, and u3 an appro- 
priate superset and suitable subproperties. 

To accomplish this, a set of "candidate" units 
for each word is prepared. A candidate unit for a word 
is a possible meaning that the word might have in the 
input. Thus, the memory might contain three candidate 
meanings, LOrmRuULe-wm eRUBn) pea rdoge (aseineriguret2:1); 
RHURE?, Gaiband around thegneck;; of RUFF3;<tostrump at 
bridge. Similarly there might be several meanings for 
chase and Volkswagen, but for the present example it 
will be assumed that each of these words has only one 
definition in memory: CHASE1, meaning to pursue down 
the street; and VOLKSWAGEN], the car. 

TLC must now choose from the candidate meanings 
the sense of each word which is appropriate in the 
present context. This appropriate meaning will then 
form the superset for the new empty unit for that word. 
In the example the system should choose RUFF1, a dog, 
aS an appropriate meaning for ul, and, of course, choose 
the units CHASE1 and VOLKSWAGEN] as appropriate for u2 


and u3. 
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Once the supersets for ul, u2, and u3 are filled 
in, reasonable subproperties must also be found. TLC 
achieves this by adapting properties which are already 
in memory; in fact, by adapting the properties of the 
newly discovered supersets. In the example the proper- 
ties. of ‘RUFF1, the:dog, would be adapted to fit the 
context of the input. The new properties would then be 
added to ul. More details of how TLC adds new properties 
and new supersets to ul, u2, and u3 will be given after 
amtuller=theorevicameexplanation Otel ntseprocess. 

TLC finds the supersets and properties of the new 
units using a single procedure: a parallel search 
through memory. The search attempts to find "seman- 
tically related" candidate units for different words 
in the input, on the theory that any two candidates 
which can be related in memory are more likely to be 
the "correct" choices for their respective words in the 
input... Thus, TLC uses its knowledge of the world” to 
decipher the context of the input sentence. 

Before the search algorithm can be understood, 
however, several terms must be defined. Two units are 
"semantically related" if one unit is "Semantically 
SOent i etab le! with theratteibute or value, of .a.property 
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(or any two units for that matter) are “semantically 
identifiable" if they have a "superset intersection" 
in memory. Two units have a "superset intersection" 
in memory 
m(L mit the =tworunlts are the same “unit. 
(2) If one unit is the superset of the other, 
Or the superset of the superset of the 
ONG, OG tiemelperser Ot tliat, etc: 
In this case, we will say that one unit 
lies directly on the "Superset chain" of 
Ehe Other, 
(3) If the two units' superset chains merge 
at some point." 


(Ou tele ie hee 9G OF. cow je 


Observe the difference between semantic relationship 
and semantic identity: semantic relationship involves 
the intersection of a part of a property with a unit, 
whereas semantic identity just involves the intersection 
GEetwOruns ts. Also; notewthat in, TLC the length of a 
superset chain has been arbitrarily limited to three 
supersets so that the model will not have to look an 
unreasonable distance for an intersection. 

The search looks at the properties of all the 
Gandidate Units, Starting with the most recently defined. 


It expands superset chains from the attribute and value 
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of each’ property of each candidate, as well as building 
Superset chains from all the candidates themselves. 

By expanding each chain only one link at a time before 
proceeding to the next chain, the search effectively 
Simulates parallel processing. Eventually a superset 
intersection occurs between a part of a property of one 
candidate and one of the candidate units of the other 
words in the input. These two candidates are thus 
semantically related and are tentatively chosen as the 
correct choices for the supersets of the corresponding 
empty units, pending satisfaction of a form test between 
the candidates. Form tests will be explained shortly, 
but first the processing of the example to this point 
should be examined. 

TLC would start expanding the superset chains from 
chepacerMoUtcesmanGevaluecomorstie properties of RUFF I, 
RUFF2, RUFF3, CHASE], and VOLKSWAGENI1. In addition 
chains would be) bualteupsitrom each of the candidates. 
Since RUFF2, a band about the neck, and RUFF3, to trump 
at bridge, are: not closely related to the input, the 
first superset intersection is likely to occur between 
aepEOperty.ot RUPEFI, agdog, and one. of CHASE] or 
VOLKSWAGEN1L. The memory definition RUFF1, given in 


BPLGUrS) 2.,)contains One property, (CHASE] CARI1), and 
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the candidate for the second word of the input is CHASE]. 
Hence, the attribute of a property of RUFF1 (namely 
CHASE1) has a superset intersection with a candidate 
Urnat- for another word of the input (also CHASE) ,°since 
they are the same unit. Thus, RUFF1 and CHASE] are 
semantically related. Similarly, RUFF1l and VOLKSWAGEN1 
are semantically related, since CARI] is both the value 
Of a property Of" RUFFI and” on the superset chain’ of 
VOLKSWAGEN1. Therefore, RUFF1, CHASE1, and VOLKSWAGEN1 
are tentative choices as*the Supersets of ul, u2, and u3. 
To make the identification permanent, each pair 
of semantically related candidates must satisfy a form 
test. “Form tests are’ the syntactic element of “TLC. 
Each property of the memory has associated with it two 
sets of form tests, one set to be used if the attribute 
of the property is semantically identified with another 
itl, anaes Ne OLNeCEL Set tompe used if the value isso 
rdentifred® ~Themrules tinea Ltorm test’ look tora valid 
syntactic relationship between the two candidate units 
Lidtecnee lest 1S) exallinine. ws cuci a relatironshi p=» could 
be the existence of a preposition between the words 
(onUpmeoOL 1 slAWy CLG CiLTent ) "ties presence OL an 
Sacomatter tie first wordsias in “Lawyer seclient’ )), or 


aivenuiven OL OLIcCE= poSolollities. li -all™ ion tests 
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faldiefor any pair of candidates, TLC’ asks the monitor 
(program user) for a new form test which will apply. 
Ih no wnew..test issforthcoming, TLC assumes’ that. the 
current intersection is not valid, and it proceeds with 
its search. 

In the example above, since the property (CHASEL1 
CAR1) has been used to semantically relate RUFF1 to 
GHASE)  sLOrmatests¥associateduwi toa. (CHASE CARI) would 
be employed on RUFF1 and CHASE1. Because RUFF1 and 
CHASE] are related through the attribute of this property, 
formetestosoiithe,fiustekind would bewtried. ».Onewsuch 
form test might test whether the word in the input ores 
ponding to CHASE] follows the word corresponding to RUFFI1. 
Similacly,,a.form ‘test.of thessecond kind would check the 
relationship between RUFF1 and VOLKSWAGEN1. If the form 
tests both succeed, RUFF1, CHASE], and VOLKSWAGENI1 can be 
Penlianenblyeaddedsasethe supersets Of ul; u2, and: u3. 

Discovering the supersets of the empty units also 
gives a method for adding new properties. These properties 
are actually adaptations of old properties in memory, 
specifically old properties which have been employed in 
getting the new supersets. Each such old property is 
GODLGOMLLOMsLhe SUNT tewithawhich.it-is associated and 
placed under the corresponding new unit. If the attribute 


or value of this property has been found to be semantically 
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identifiable with the candidate of another word during 
the intersection process, then this attribute or value 
is replaced by the new unit representing that word. 
Otherwise the property is left unchanged. 

In the example the only cal nee which has been 
used in finding the new supersets is the property (CHASE1 
CAR1) which is appended to the unit RUFFl. Hence, the 
associated new unit ul is given the property (CHASE1 
CAR1). Since the attribute CHASE] and the value CARI 


have been semantically identified with candidates CHASE1 


and VOLKSWAGEN] respectively, they must both be replaced 
by the corresponding new units. In this case CHASE1 is 
replaced by u2 and CARI by u3.. Thus, the new unit ul has 
the new property (u2 u3) attached to it. Note that 
RUFF1 still has (CHASE] CARI) as a property, since the 
copying and modifying of properties in no way changes 

old concepts in memory. 

After TLC has set up new units and new properties, 
it creates, if desired by the monitor, new dictionary 
entries by associating the new units with the proper words 
in the input. Therefore, Ruff, Chase, and Volkswagen 
could be the dictionary entries associated with units ul, 
Us ectiomicm (WotCchetoOLeconciecency Of notation will now 
be termed RUFF4, CHASE2, and VOLKSWAGEN2). Figure 2.2 


shows the new concept which TLC has just produced. 
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Dictionary entry 


Ruff 


RUFF1 | 


es “) 


CHASE2 VOLKSWAGEN2 


Figure 2.2 The memory concept for RUFF4 


The final action which TLC undertakes is to respond 
inebeseasbOrmat a(parddiomatic) English. ~Thas natural 
language response indicates to the monitor how TLC has 
PiCeLDLOeeUrtic, INnpUtwmeeict=tOsbe=sure that thesmonitor 
understands what is going on, however, the program also 
produces a nested structure corresponding to its internal 
representation of the input. In the example the output 


might look something to like 


((RUFF (CHASE (VOLKSWAGEN) ) ) ) 


HERE WE ARE CONCERNED WITH RUFF WHO CHASES A VOLKSWAGEN 


Biguverss. 8 Output irom TLC 


AtekValuation Of TLC 


The Teachable Language Comprehender is a very ele- 


gant model of language behavior. Its procedures are based 
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on what little is understood about the one comprehensive 
natural language processor so far in existence: the 
human brain. Thus, TLC relies heavily on intersection 
"fans" spreading out from concepts in memory in a breadth- 
first procedure similar to the parallel processing which 
is theorized in the human brain. A second feature some- 
what analogous to the human brain is TLC's highly inter- 
related, content addressable semantic memory which is 
responsible for many of TLC's success. Both features 
differ markedly from the serial processing and location 
addressable memory that have traditionally been associated 
with computers. 

The essence of TLC is its simplicity. The memory 
structure consists of only two entities, properties and 
units),,and vet it 4as,able to represent. complicated nested 
concepts to any level of recursion. The superset connec- 
tion between units allows impressive deductive processing 
to be undertaken, and the broad definition of the properties 
allows relations of remarkable richness to link the memory 
together. The memory is also well suited for the easy 
Grans kai oneolt naturalgenput into ats) format. 

No less an achievement is the procedure for inter- 
DLelLINGmMCie Input pesUounge cusangle, algorithm) TLC not, only 
comprehends natural input, deciphering many of its ambi- 
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contained in the input to properly update its "knowledge 
of the world". In fact, comprehension in TLC is defined 
torbe thie "translation of the =input into memory structure 
format. by coding alll ’text™inm theYsame "constructions as 
those of memory, the model also eliminates the need for 
special procedures to process anaphoric references 
(references to something already stated in text). 

Among the weaknesses of TLC is its very emphasis 
on semantics which, while good in itself, results in 
syntactic processing being reduced to a few form tests. 
Even these are somewhat crude, leading Quillian to propose 
using "a transtoriationa lb syntactic®approach*similar to 
PictespEOGraMmmed soy slewame ced lel 9O9)ee—ererians, (LOO; 
syntax could be used to help eliminate the multiplicity 
of candidate units before the time consuming search routine 
goes into operation. Syntax could also be invaluable in 
discovering which words of input are likely to be related 
so that TLC could concentrate almost exclusively on look- 
ing for semantic intersections among these syntactically 
related words. Finally, syntactic procedures to handle 
suffixes would eliminate the artificial separation of 
suffixes from the words with which they are associated. 

OuLllian*points out that the intersection techniques 


need to be refined to some extent, as well. Procedures 
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which allow the system to correctly interpret "enemy's 
lawyer", for example, lead it to falsely interpret 
"lawyer's enemy" due to overpowerful intersection 
techniques. On the other hand, many intersections 
(such as intersections between parts of separate 
properties) which are potentially useful in what 
Quillian calls "indirect comprehension" (Quillian, 
19697= p46 7)ijare Gqnored maT Le also. has difficulty 
comprehending totally new concepts, since no scompletely 
new properties can be added, only adapted properties 
from old concepts. 

Adding a new unit for each word of input means 
tia Gale Gibuirldsiup siitsamemory muchs too srapidly. 
Procedures should be devised which allow the system to 
ROG et aenOstws, OG itswinputieaee niaddation»~.the attaching 
of each new unit as the subset of an old unit allows 
superset chains of extreme length to be developed. 

The forgetting routines should also be able to amalgamate 
or eliminate many of these units. 

TLC has no explicit question answering techniques. 
As will be seen in the next chapter, some implicit ques- 
tion answering is possible as a by-product of the 
comprehension process, but there are no direct procedures 
for responding to queries. Neither is TLC designed to 
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given the input. For example it would be useful to 
have the system not only be able to code the command 
"Halt processing" in its memory format, but also be 
ablestomactually halt@after so coding. At present, 
the only action that the system can undertake is READ, 
which precedes all input and just tells the system to 
perform its comprehension process. 

The final fault which will be mentioned here is 
that eoLC eis igui tewhard tonusezarThesmonstomehas /to “be 
trained to know exactly how to state input, how to 
understand the response of the system well enough to 
be able to see if it is performing properly, and whether 
to add the newly interpreted input to memory. He must 
also know what to do when TLC requests a new form test. 
As the system develops beyond the experimental stage, 
these problems will likely disappear. 

MUSE has been designed to overcome some of the 
shortcomings of TLC. Although less sophisticated than 
Quillian's model in some areas, MUSE is equal or even 
superior to TLC in others: Chapter III details the 


theory behind MUSE. 
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CHAPTERS TL 


FORMULATION OF MUSE 


iq\esslarshbeyesk opel 

MUSE is a natural language model which understands 
Simple written English input by transforming it into a 
grammatically correct and semantically well-formed 
internal representation, called the model's "interpre- 
tation" of the input. Any motor actions required are 
then performed, if possible, before the model asks for 
more, text to be) input .») Some’ portions of this’ unders-— 
tanding process are borrowed from other natural language 
models, notably TLC, and some parts are original. This 
chapter describes the design of MUSE, although many 
details of the implementation are left to Chapter IV. 

MUSHEs bascda@divest1y enelLG,;ssomthat most of 
the terms used here have the same definitions as in 
Chapter’ Il. MUSE» attempts to overcome many of the 
faults of TLC while still retaining the semantic orien- 
Cation ofeOulll tani smmode lweeSyntax in MUSE 2ssmore 
sophisticated than in)’ TLG and enables the system to 
eliminate many useless candidate units before the 
complicated semantic processes are implemented. The 


syntactic component also helps to direct the semantic 
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component; that is syntax is used to discover what words 
of the input are most likely to be semantically related. 
As well, syntax aids in the derivation of new properties, 
Yatherethan justiichecking old sroperties’, as’ is idone ‘in 
ie. 

Instead of adding new units to memory for every 
wordeOofethe=input, MUSE triessto modity old units: to 
encompass the input concept. In fact, the only way 
that new units can be added is by specially marking 
the input words. Thus, MUSE avoids the problems of 
excesSive memory size and extraneous supersets, MUSE 
also allows for "actions" (pre-programmed executive 
routines) to be linked with each unit. These actions 
can be specialized syntactic and semantic procedures to 
act on the input during the interpretation process or 
MOCOLMaCtLIonsS SUC aS! Walt~ewoiLch act) arter the Input 
has been interpreted. Finally, limited question answering 
facilities have been incorporated into MUSE. 

MUSE As probably not as flexible as TLC, mostly 
due to the limitations of the syntactic processes. 

Tue, thie Dreadtni=-LirStsmitersection order of TLC is 
abandoned to a large extent in favor of more localized 
Syntax directed searches. In addition, MUSE eliminates 


suffixes, tenses, plurals and the like so that root words 


4] 


can be more easily discovered. Also the format which 
must be used to communicate with MUSE is probably more 
mitlexrole chan that or TLC. ™The*monitor must know 

quite a lot about the workings of the system before he 
can use it, especially if he is defining new words, or 


editing MUSE's memory. 


The Memory Structure of Muse 


MUSE has a memory structure composed of three 
components: a dictionary, a semantic memory, and a 
SVitcow GulC. elie dictionary Consists of Knglish words 
with pointers to corresponding units in the semantic 
Memory. A word can be any expression comprised of English 
letters (A BC... Z) with no blanks. Because many words 
can have more than one meaning, it is possible for a word 
in the dictionary to have pointers to more than one unit 
in the semantic memory. Of course, concepts in the 
semantic memory do not have to be stateable in English, 
so that not all units have to have a corresponding 
dictionary word. However, in the examples which have 
been run so far, all units do have corresponding dic- 
tionary words. 

The semantic memory consists of a file containing 
units and a file containing properties. These units and 


properties can be considered to be conceptually identical 
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to those of TLC. There are some differences, however. 
Minwemasvea pointer to its? superset’ and pointers” to 
Tissubprope cties ase inwlLGyebut an addi tionat can 
have pointers to any actions to be undertaken when that 
unit is encountered at various stages of processing. 
Apanenot speech markersiwteo be: used “Un'syntactic analysis, 
is also attached to each unit. The properties are un- 
Changed) from TLe. “Note tthat “for the? sake of'isimplicity 
no allowances have been made in the memory format for 
the quantification of units or for units which have been 
grouped into sets. 

The third portion of MUSE's memory structure is 
apr lemcOncaliing part OL speech combinations and cor— 
responding phrase markers (sometimes called "parse trees"). 
This is the syntactic component of MUSE and takes the 
Blace,OL TLC Serormecests «nl )avalid parse trees (at 
least as far as MUSE is concerned) can be extracted from 
this syntax file. A valid parse tree in MUSE must satisfy 
certain special conditions to enable correct processing 
tostaker place. [he tree must have exactly two branches 
from all nodes except terminal nodes; it must define all 
adjectives and adverbs in adjective and adverb phrases 
which must follow the word they are modifying, and the 
Pie eo canch OLewiLChoMustrcona an a “null” node; and 


the tree must define a branch ending in a null node to 
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stand for the implied subject of any imperative sentences. 
The last two conditions are to allow the model to properly 
perform specific actions, and.a further explanation is 
given later in the chapter. By storing phrase markers 

in a file instead of defining a parse procedure, many 
difficulties of implementation and excess processing time 
are avoided, although eventually a programmed parsing 
routine (such as those used in Coles, 1969 and Tharp and 


Krulee, 1969) should be added to make MUSE more general. 


Process nce Comm pUEeCOMuce 


A flow chart outlining the operation of MUSE is 
given in Figure 3.1. The present section explains this 
flow diagram with the help of a familiar example. Once 
more it is assumed that the model knows three meanings 
of Ruff, one of chase, and one of Volkswagen, the famous 
RUBE (a dog); /"RUFF2 (a band around the neck), RUFF3 (to 
trump at bridge), CHASE1, and VOLKSWAGENI of the last 
chapter. Again suppose that "Ruff chases Volkswagen" 
is the input sentence to be understood by the model. 

The input to the model must satisfy several res- 
tyictions before it can be successfully processed. The 
input must not contain adjectives, adverbs, or preposi- 
tional phrases which modify other adjectives, adverbs, 
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prepositional phrases may modify nouns or verbs. Con- 
junctions between words (e.g. "dog and cat and mouse") 
are not allowed, but conjunctions between clauses are 
aceepran be saslteadd ita On maquantis 1 Cationsand negation 
cannotsbe handled bysMUSE,  Oncer aj word, ins the Gnput has 
been defined, it must always take the same form in all 
future references, since MUSE has no facilities for 
recognizing plurals, tenses, agreements or the like. 
Thus, for simplicity all nouns are assumed to be singular 
(ol Geue COGmenOLeOOGgSin)s, andaverds tosbesantanitivesade.g. 
EbeowmanstecdnOt mew Sar, auwas 1,6 CCC.) rae Moreover, Lf a new 
word is being introduced in the input, it must have 
appended to it in brackets its part of speech and pointers 
to all actions which apply to the word. All words in the 
input must be separated by blanks, and no punctuation is 
allowed except a period or question mark at the end. No 
words may be capitalized, and all must satisfy restric- 
CLOnSsepwaACecdROnsClchLionanyecntrics.pekhinadlyyeall input 
must be processable by both the syntactic and semantic 
Conponenis Ob MUSK msosethaw,, fEorjexample;, no sentences 
will be understandable unless they have appropriate phrase 
markers stored in the syntax file. The input sentence in 
the example would be typed "ruff chase volkswagen", which 
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MUSE initiates processing by notifying the monitor 
that it has started by typing the sentence "GOOD MORNING. 
MY NAME IS MUSE.". The model then reads stored files 
contauningwthendictionary,ethe units, the properties, 
enue cleesyitaxeconethepsystem.SeMUSE is"now ready to 
Seceapeeinpucmscomit StavessoPLEASEOTYPESYOUR INPUT. “hand 
WaltUSEelOn amresponses sit 1s at ChusWpointethat  "nutt 


chase volkswagen." is typed. Upon receiving the sentence 
to be processed, MUSE checks to see if the input contains 
HtLeOor Ssaue thettasteexits £Lrom MUSES so'’called because 
they tell MUSE to immediately stop processing. A "+" 
indicates an immediate stop without storing any memory 


wou 
2 


files, whereas a is used when it is desired to stop 
MUS@@aGter storingeits =files.5OIn either case "MUSE prints 
out "THANKS FOR THE CONVERSATION." and stops in the 
appropriate manner. 

3 if the dnputerdces snot ecequixe*a fast exit) MUSE 
initializes a number of variables and proceeds to 

attempt to "interpret" the input. As mentioned in the 
Tieroeduction, aneinterpretagion of Othe input “18 "4 "syn- 
tactically correct and semantically well-formed internal 
ELepresentation of the input.  Ae* valid” interpretation 


is an interpretation which the monitor has judged to be 


correct. When trying to discover a valid interpretation, 
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the first thing the model does is read each input word, 
SeiinectecdeDyeblanks runt Wheehncounterssa “Alcor, "2, 
indicating the end of the input. MUSE then checks for 

new words which, it will be recalled, are marked with 
brackets containing a part of speech symbol and action 
pointers. Any new words found are added to the dictionary, 
either as another meaning of an old word, or, if necessary, 
as an entirely new word. The new dictionary entry contains 
a pointer to the new unit which is defined for each new 
words SIhiws uUnsteise®iimlled in withthe. part® of ‘speech 
symbol and action pointers contained in the brackets, and 
is also initially given a pointer to the null superset 

and the null property. Properties and supersets are later 
discovered from input text. Note that since new units are 
added to the end of the unit file, then the higher the 
unit number the newer the unit (e.g. RUFF3 is newer than 
RUFF2). All new units are flagged for the duration of 

the processing of the current input sentence. This is 

done soO’that no other candidates units will be tried for 

the new word, and so that the actions associated with the 
new unit will be suspended long enough to ensure proper 
Titen pret atwoneok the UInpumeni. e.eit ithesaction associated 
with a unit told MUSE to delete the unit wherever it 
appeared, then the unit would be deleted before it could 


be added to memory unless the actions were suspended the 


x 


, *: 
& ‘ 
ro 
a7 
» 
\' 
va 
« 
8 3 
* ! 
GE 
* 
_ 


itow 
— 


it 1 _ 
eeeb. Isham ok 


Jidal doco boas: 


: }! auf, 
Wet $6 - Ws li. Go 22 MODS dir r crct <3 ya 2 
* « bed br : o 
: : a 
¥ ‘ ~ rid? 
= _ wm at zo + “ry zy - ry + yy 
aot avostia rion iM. “sints = =) 
: 7 - 
F Hefty i of l= 
iséw bots 4p ,balisoe i Ji 
Hokies bor t > Ste oa. 
* P r 4 _ q . 
Avi A J a i ns 
> 
: - 
r - 4 a 
; r4 ‘ 1 ‘ rel ; 
~ 4 
} ‘ ~ * é 7 : 
Tal as + » i Waetk 
P + eon “ ca ; >t 4 
Hy ] : r 9 : Oc 
| 4 =f 5 
7 = ¢ - 4 F 
4 f 5 {[3. Les o Vi . 
‘ : c +3 Fi 
: : bn S| io 4 aor —— 
| a4 
7 7 
a y a : ; 
: OE XM , = at Soil Lee 
; | Sa duqct diszeno oft fo: onaees 
> * “> 1 - - 
: r 7 5 bh fe: = vs iis on ‘Ay re 
+ WD ak - J Siac, Qe br pane: we 


oa -_ 
(ata. ‘eet pare ower 


7 - > 


S76 Leaf os. ae poutine ae 


48 


Prescwe me ti raugn) .ror course, tn the "“rutt chase 


volkswagen." example no new words have been marked, so 
most of this processing is avoided altogether. 

MUSE now proceeds to discover the candidate units 
POrseacr word inthe input.) she candidate units Eor’a 
word are all units associated with that word in the 
CVetvonary (called “Pirsy, level! ‘candidates), “plus all 
"subsets" of these units. UNIT1 is a subset of UNIT2 
VeeUNTT 2S Tes One thessuperset Chain of UNITI. “Note*that 
there is no limit to how deep the model goes when looking 
for subsets - it keeps going until all subsets are found. 
This feature becomes quite important in question answer- 
ing, as will be presently seen. In the example the 
aqrctionary una ts associated with “ruff” are the units 
RUPP, PRUFF2, and RUFF3; “and since none of these units 
has a subset, these are the only candidates. Similarly 
the units CHASE1 and VOLKSWAGEN] are the only candidates 
for the input words "chase" and volkswagen". 

MUSE is now ready to choose "combinations" of these 
Cancraodcesrand dow Lurtier processing On Cac such com— 
bination. Atcombination or Candidate units 1s a vector 
36 units representing one possible choice for the mean- 
Bg *OL Gach input word. Pt™is desirable’ to have some 


sort of order in which to examine the candidate combinations, 
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preferably an order that will yield the "correct" com- 
binartons(ine. 82 COMDination which results in a valid 
MHEeLOroLati on) as Guvckly as) possible.  Loward this 
end MUSE orders the candidates for each word, grouping 
the candidates first according to their parts of speech. 
Mewcanairaates, In eacie part, Of speech group are then 
arranged according to how deeply they are removed from 
the first level candidates, the "shallowest" units 
coming finst, Finally, any candidates in”"the* same part 
Of Speech group and on the same level, are ordered so 
that the most recently defined come first. Thus, the 
candidates for "ruff" in the example would be arranged 
RUPP Oo pmeCOmELUND yeas tic Ollyeavetb, DLOllowed Dy RUFF2Z;7 a 
DaliGeecound tne "Weck, and RUPFi, the dog, as*= the nouns 
which are arranged in order of recency since they are on 
the same level in the semantic memory. CHASE1 and 
VOLKSWAGENI1, being the only candidates for the second 
anOmommML Ost DUE wOLds mnecd moO Ordering. (thus, there 
are three possible combinations of candidates: 
RUFF3,CHASE1,VOLKSWAGEN1; RUFF2,CHASE1,VOLKSWAGEN1; and 
RUFF1,CHASE1,VOLKSWAGEN1. 

The actual choosing of the candidate combinations 
is now accomplished with the help of a generator which 


enumerates all possible combinations of integers in some 
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in some maximum vector. The generator starts with a 
VoOCLOmOce luc and, abyeincreasing the leftmost columns 
Oba NeaveclOuetirst, aproaucesanew combinations .one,at 
a time until the maximum vector has been reached. For 
example j~isethesmaximumy vector is,2. 3 1, the following 
Dect OoromwouLam oes produced mi nmOLOeta tl) Leeleeg2 mlee dito] ge2uolss 
IR RES ey ee 

It is clear that the same sort of generator can 
be used to generate indices to examine appropriate 
combinatronswole@candidates,;Pone’at atime. “SIinvfact; 
two such generators have been defined, one to produce, 
one by one, all "part of speech combinations" and the 
other to give all possible combinations of candidates 


J 


withvneecach™=part of speech combination” *(a part "of 
speech combination is a vector of parts of speech of the 
mnput)s 

It now becomes clear why the candidates are ordered 
WLEnS pale Of Speech! first —-“tol enable*™the part’of speech 
generator to examine the part of speech combinations 
without redundancy. This saves a good deal of processing 
time, although it does detract a little from the desired 
depth-first order of candidate examination. In practice, 
however, -this*obyection» turns out not to be too serious, 


Since usually most candidate units for a word are the same 


part of speech, thus allowing depth-first ordering to once 
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again become dominant. In the "ruff chase volkswagen" 

example there would be two part of speech combinations: 
verb,verb,noun and noun,verb,noun. Within verb,verb,noun 
there is only one combination of candidate units, 
RUFF3,CHASE1,VOLKSWAGENI1; but within noun,verb,noun 

there are two candidate combinations: RUFF2,CHASE1,VOLKSWAGENL 


and RUFF1,CHASE1,VOLKSWAGEN1. 
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MUSE now generates the first part of speech combina- 
tion and searches through the syntax file for associated 
parse trees. If no parse trees are discovered, the model 
rejects the current part of speech combination (along with, 
of course, all candidate combinations which are subsidiary 
to that part of speech combination), and generates a new 
Pact, Of Speech wcombination. Lf one or more parse trees 
are found, the first is taken and processed until it either 
Viclico@emVvolLCmi Neel pCetdtlOnwOreilteas rejected. § If it 1s 
rejected, the next is taken, and so on until all parse 
trees have been tried (whereupon a new part of speech 
Comoinacron VssGenelateca mor Until a Correct parse tree 
has been discovered. The parse tree being examined at 
BvyeOucmulmem SecaAblcdmeticuscULrent. parse Crec. 

In the example the verb,verb,noun part of speech 


combination probably would have no parse associated with 
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Hey SOuwould be rejected immediately. ‘In this case, the 
candidate combination RUFF3,CHASE1,VOLKSWAGENI1 is no 
Ponger considered a possibility for the meaning of the 

p Beh eisl ox On the other hand, there likely would be a parse 
tree associated with noun,verb,noun (such as the tree of 


Figure 3.2), and this would become the 


Figure 3.2 A parse tree 


CUPreCnURpalrSseutroe. se lhus,, the syntax Look-up has already 
eliminated one candidate combination for the meaning of 
the input, although two more remain: RUFF2,CHASE1,VOLKSWAGENL 
and RUFF1,CHASE1,VOLKSWAGEN1. MUSE must continue process- 
ing in order to choose between these two candidate combina- 
(eayeyateys 

After obtaining a parse tree, MUSE calls in the 
candidate combination generator to eters in order, the 
candidate combinations which can be passed using the 
current parse oe Each candidate combination, as it 
is produced, becomes the "current" candidate combination 
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preted or until a failure occurs somewhere. If a failure 
occurs, the next candidate combination becomes current 
and is tested. When no more candidate combinations can 
besproduced, theimodel returns for a-new parse tree. 

Once a current candidate combination has been produced, 
the units comprising the combination become the terminal 
elements for the current parse tree. In the example, 
RUFF2,CHASE1,VOLKSWAGEN1 would become the current candi- 
da berconbinatizon ;mandmine jpansestuee would poe, filled jin 
ashinanl tgurcess3geelt this jcandidate-combination.were to 


fail, RUFF1,CHASE1,VOLKSWAGEN1 would be tried. 


aoe 
wa 


CHASE1 
VOLKSWAGENL 


Figure 3.3 Parse tree filled with candidate combination 


MUSE now performs any "A-actions" which are asso- 
Cratea with the =candraate units in *the current ‘candidate 
Combination. Recall "that an action 1s a” pre-programmed 
executive Lourtine whieh 1S linked to a unit. “There are 


actually three types of actions in MUSE (A-actions, 
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Beacterons;ecrcactions) which are applicable, at different 
stages of the processing of an input sentence. Any 

unit can have at most one of each type of action 
associated with it. A-actions are actions which are 
applied to the terminal units of the current parse tree 
at this point. These actions include one that deletes 
the associated candidate unit from the current parse tree, 
such as is done with articles like "the" and "a" and 
subordinate ‘conjunctions like Mthaty’. 9 -Uniststwithoathis 
action shave Syntactic Significance to MUSE (since the 
units were used in obtaining the current parse tree), 
but no semantic significance. Another A-action adds the 
unit SELF1 to the parse tree as the subject of a verb 


WhtcnmnaseNOomrOouyeCe an che ClUcrent parse. ~fhis allows 


MUSE to process imperative sentences. The final A-action 
inserts the superset of an adjective or adverb into the 
current parse tree, thus enabling the model to handle 
attribute-value pairs which modify the word with which 
theywere wassoeciaced. “The attribute wis the superset of 
the adjective or adverb, and the value is the adjective 
Gree verpeltcel tf i(e.g = COloLeorown, speed fast, etc.) . 
BormepociIe cer secondmandmetiirdsA-actlons, Che parse 
tree must be specially designed to allow the addition of 


Chesunttseiu thie appropriate place. This 1s accomplished 
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through™ the’ use of branches in the parse tree that end 
inarciie wnulieeunits. §Thesemnull units are then filled 
in’with® the=proper units derived by the A-action. ~An 
example of the third A-action, adding a superset to an 
adjective or adverb phrase, is now given. Figure 3.4 (a) 
shows the parse tree for the input phrase "brown dog" 
(with associated units BROWN1 and DOG1), and Figure 
3.4({b)= shows what happens when the A-action of the third 
type which is associated with BROWN1 is applied to the 


DekrsSecmcree: 


NP NP 
peplscatloneOt a X 
Pe Age OEE ee Adjective 
Phrase AaCwoneot Phrase 
YP Enemy be 
0 BROWNL COLORL BROWN1 
(a) (b) 
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type linked to BROWNI, so ie, Aegbviginte) tmlep Teale celliaicmwe jeekecis 


CLecmiriqure 3.4(a)) andwtinds that BROWN] is dominated 
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by an adjective phrase which has a null node. MUSE 
finds the superset of BROWN1, say COLOR1, and replaces 
thesnulisnode by the: unit COLOR] (see tree in Figure 
Seah) ethuseconpleting  wthevaction.» dnp the. “ruffschase 


volkswagen." example, no A-actions are associated with 
any of the units in the current candidate combination, 
so the current parse tree remains unchanged (still 
EAOur es .3) i. 

Once the A-actions have been performed, MUSE 
attempts to convert the current parse tree into 
ee election aleecr ip lesnotationi te fEhasen-cissimilariitouthe 
Paipt eanotatvonrdenimed i neochwamzs ctya l-3( 1907/0 )i and 
involves amalgamating the terminal units of the tree 
into triples which are syntactically related. The 
essential idea is to associate the nouns in the parse 
tree with their modifying verb phrases, prepositional 
pirases, and adjective phrases; and to associate the 
verbs in the tree with their modifying prepositional 
phrases and adverb phrases. Figure 3.4(b) shows the 
Senecdie structure) of amunat andiits modisyingephrase) — 
the unit (DOG1) and the modifying phrase (Adjective 
Phrase) are both on the same tree level, and the com- 
ponents of the phrase (COLOR1,BROWN1) are on the next 


level eeelhusjeca) relational) triple,is defined, to be an 


oO” 


erderedmorilp lve ofr terminal uni ts™uly U2," and’ U3“of- a 
pDeboes uscemocuche tivate Uleivsma soun or a verb onthe Same 
tree level as a modifying adjective phrase, adverb 
phrase, prepositional phrase, or verb phrase; and U2 

and U3 are the terminal units of the two branches leading 
from this modifying phrase. 

Breaking a parse tree into relational triple 
NOtabiony CONnsSiTSstse oly findingmall@the relational triples 
in the parse tree and placing them one after another in 
ameVectorumor triples: (‘All parse treesewhich are=still 
active at this’ point in MUSE|'s’ processing should be 
reducible to relational triple notation, since both 
the input and the parse trees themselves have been 
restricted especially to allow eee For example the 
relational triple notation for the sentence "rover chase 
green volkswagen down street." would be (ROVER1 CHASEL 
VOLKSWAGEN2) (CHASE1 DOWN1 STREET1) (VOLKSWAGEN2 COLOR1 
GREEN] )Reethesrelatdonal® triple notation forthe current 


parse tree in the "ruff chase volkswagen." example 
consists of but one triple: (RUFF2 CHASE] VOLKSWAGEN1). 

The model must now perform all "B-actions". These 
actions, cassociated with the units’ of the current candi- 
date combination, perform various procedures on the 


newly discovered relational triples. There are two 


B-actions which are necessary in MUSE, the first because 


58 


of the way the verb "to be" is defined in the model, the 
second because of the manner in which prepositions are 
specified in the semantic Memo cy wae ln eMUSE sthe input 
sentence "A be C" usually means that C is the superset 
OteAyme re. ethemrolie of sthe kverb. | tosbe. is, usually. to 
denote superset relationship between units. To indicate 
to the model that a superset relationship obtains between 
Ghesuntes of sthe seuiple; sragmerethangthe,ordinary, unit 
modified by a phrase, the verb "to be" is replaced by 

the yn Iain ee (aes s 02 wherever viteoccurs in the 
triples. The remaining two units are considered by MUSE 
to have a superset relationship between them. Thus, the 
first B-action is executed on all units in memory that 
define a superset relationship (e.g. "to be"), and it 
results in the unit being replaced by the null unit 
everywhere in the triples. The triple (DOG1 BE1l ANIMAL1) 
would, for example, be reduced Om DOG On, AN IMAL) ate BE 
had a B-action of the first type associated with it. 

The second B-action is needed because of the way 
prepositions are defined in MUSE. A preposition is 
considered to have no subsets or properties, its mean- 
ing being determined by its superset. Thus, the 
DESpOswiaoOneOml anethestaiple. (CAR1 OF1, JOHNL) might 
havemsupersets HAVE, indicating that in the present 


eornvexte OR] means HAVEL. The second B-action when 


Se) 


Beep Mmedmcorcsunit Ina triple, replaces that unit by 

its superset. In the current example this would yield 
(CAR1 HAVE] JOHN1) which is the opposite of the intended 
meaning. Therefore, the second B-action also reverses 
Bienun bes ssUGrOUndiIng the actioneunit 2n the triple to 
yield (JOHN1 HAVE1 CAR1), the correct interpretation in 
tHemOresenveacircumstances. —sltethe superset is the null 
UNlo, -enewuniLts "are still reversed, but the action unit 
is replaced by the null unit. For example, the unit OF2 
in (COLOR1 OF2 DOG1) might be defined as having no super- 
set in memory, but still have the second B-action. When 
Clem haaCt1 on. sls applied to the triple, it becomes 

(DOGI= OF COLOR) [htsmismanecexanole Orea second type 

Cee CWORUNTteLLI DLC, mOnestiacwdoes NGl derine av subset— 
superset relationship. "Consolidation" routines (explained 
in the next section) help MUSE to amalgamate such two unit 
ero lest Limo ele mt ial ple somOmmLNeC.m NpUt,., and lence 
SniminalLesanyranvigGulcy.melaus tne Second B-action 

is able to handle prepositions with null supersets. Of 
course, this action does not have to be associated with 
abiepresosterons, Only wien those such as “Or or “for” 
which define an inverted relationship between words. 

Any preposition without the second B-action, or which 
Hasmtie second B-action but does not appear.in the middle 


Cumvecmccrple, Ls LeLt alone. 
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The B-actions leave many loose ends untied. What 
HhappenSetOeaetciple which has en lyeODe wD LES Orenasea |) 
units the same? What does the system do when it 
encounters a "to be" verb which does not define a 
superset relation at all, such as in the sentence 
"dog be brown."? How does the model handle statements 
like "chase be pursue down street." so that the prepo- 
Sitional phrase "down street" will modify the verb 
"chase", not the verb "pursue"? These and other problems 
are solved by a set of routines which "consolidate" the 
triples as much as possible. The consolidation routines 
are ad hoc procedures derived from a few examples, but 
it is hoped that they are generalizable to a reasonably 
large set of words. Only testing MUSE for many sentences 
will determine how comprehensive the routines really are. 

DUI NgeLlerexecuLTOns Oust heeb—aCttONs , Liss 
possible that some triples will have been reduced to 
ObecmUNLt Cl wsPeLhaDs, sROnUni to. elt 1s,also possible 
that some triples will have been defined whose units 
anewa lWieidentical. s ineelther case, it 1s assumed, that 
Pemel oO CeCon La tS elOmecd etn LOLMa wLOl wey llUG, eLle Gist 
consolidation rule is to delete all triples which contain 
NOsMOLouGlaimOneeGastinGtusunit. 

As mentioned above, problems arise when the verb 


PPoube does not implysa superset relation, “but, merely 


yall 


aulinking@ebetweenwan adjective and a nouns ‘The triple 
notation representation of the sentence "dog be brown." 
would be (DOG1 BE1 COLOR1) (BE1 COLOR1 BROWN1), the unit 
COLORI1 resulting from the A-action which adds the super- 
set COLOR] to the adjective BROWN1. The first B-action 
associated with BE1l would reduce the triples to 

(DOG IO COLOR )ea(O "GOMORM BROWN ])s. iNew) et Eas iclear 

that these two triples are closely related and, in fact, 
can be amalgamated to the single triple (DOG1 COLOR1 BROWN1) 
without loss of meaning. This, then, is the second con- 
SG@iuidatronenule shart ja triple ofethewrormi(aAno B)’ precedes 
oti plemot thes forum (OFB YG), merge ithe ttwotriplesminto 
enemsang le Eitole, witeh slormaty (A 3B CG) 

MUSE also uses a consolidation routine to solve 
the problem of how to account for such sentences as 
"chase be pursue down street.". The triple notation 
for such a sentence is (CHASE1 BE1 PURSUE1) 

(PURSUE] DOWN1 STREET1) which reduces to 

(CHASE1 O PURSUE1) (PURSUEL DOWNT STREETI) after the 
Ao Caron aOLioseClLONG mm CUASH I BhasmsUperse Ce PURSUEL, 
but the prepositional phrase DOWN1 STREET] should modify 
CHASE], not PURSUE]. The reason for this lies in 
Cuukbiamis: definition Of "a concept given on page 462 ‘of 
rime Go eoaper: eaLAll SpLroperties pointed ‘to in a) unit 


ut 
represent predicates which, when associated with that 


a property is associated with the superset, but connected 
COMmEnonuUnit. 
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units! superset, constitute the concept the unit repre- 
sents. wine this example DOWN] STREET] is the property, 
GACH ersecho nit, sand PURDUBI© 1s the superset which 
DyeOul Pian Ss detinttion implies that DOWN]. STREET L 

should be connected to CHASE1 not the superset PURSUE1. 
PaseOmoneciverexonp lems sthnestnucanscomsolidation rule: 

if a triple of the form (A O B) is discovered, interchange 
Pe UUme OL ce triple; sandmineallwothersthreeminit triples 
which follow this triple replace A by B and B by A wherever 
Ee OCCU wa Duc mec NeeanewenoOtatvonels. (PURSUE O CHASE) 
(CHASEL DOWN1 STREET1). There are three things of impor- 
tance about this rule. First, no triples which precede 

the (A O B) triple are affected, so that sentences such 


as "chase down street be pursue." will be interpreted 
COureccly mmsccCond, sany CWO.UNemcLiples whach fol low 
will not be reversed, thus allowing more than one superset 


to be defined as in the sentence "ruff be dog that be 


animal." which reduces to (RUFF1l O DOG1) (DOG1 O ANIMAL1) 
before consolidation and (DOGlO RUFF1) (ANIMAL1 O DOG1) 
after sonceisenen. Titer owowes  deniuning, supersets 
Suchmas (ALON) are noweceversea, that +s the first 

element is now the superset of the third (e.g. (DOG1 O RUFF1) 
rather than (RUFF1 O DOG1)). In the "ruff chase volkswagen.” 
example, no B-actions are performed, and no consolidation 


is required. 
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Semantic PROCESS ING=OL eLne Input 


so far in its processing, MUSE has reduced the 
Currveontepelse CLecetOva  sectsOr relational, triples which 
Nave been acted upon and consolidated to as compact a 
form as possible. The model now tries to discover if 
the triples are semantically well-formed. MUSE assumes 
Ehatseach triple is related\tomasmemory -concept, and 
it proceeds to try to discover exactly what concept, 
if any. This is accomplished by using the fact that 
SlemeuloLeanOeael OnmeismVCLYESIMminar eto the notation, Of 
the semantic memory, that is the two unit triples can be 
compared to subset-superset connections in memory, and 
the three unit triples are very similar to memory units 
modified by properties. 

MUSH el OOkSeaotecaCimtcitplemin turn, Starting at =the 
left-most triple. If the triple being examined is a 
EWOMUG ceed OLe, eel elosmenemrOorme(A O8G) where A and C 
areeMenOry sunt tSeonOnOMLSmeno mull Unit. § Since two unit 
triples represent subset-superset relations in memory, 
MUSE assumes that unit A lies somewhere on the superset 
chain of unit C. The model iterates the superset chain 
CUmGmun an ero nCswA mOLmUIGllLm te arrives. at the end of 
the Chain. If MUSE does not find A, the triple is judged 


to be "semantically ill-formed" (opposite of semantically 
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Vole EOrmodjme ana 1s i laggedasaccoraingly. If A lies on 
the superset chain of C, however, the triple agrees 
with the semantic memory and is regarded as semantically 
well-formed. In either case, MUSE proceeds to the next 
ni olor 

Pie lomurlLolencibGentlLyeUnCe Gs COmslieratLoOn 1S a 
eimocmulrimertp Leg lc = OimlieGe reli (Aspe) )i;fLt..LS 
assumed to represent a unit-property relationship in 
‘memory (i.e. the unit being A and the property (BC), 
OGLenwindicatedspy Lie snotatcion A-(B C))< MUSH attempts 
Com) Named eR SEW Ii related unit-property combination 
in the memory. Before going further, recall the defini- 
tions of semantic identity and superset intersection in 
memory, remembering especially that two units can be 
semantically identified if they have a superset inter- 
section in memory. The notion of semantically related 
unit-property can now be defined. Assume that there is 
See GCCeUU TLE Gp CeO mete nCmiOumMe (ANB C)r and) that there 
is a unit D in memory having a property with attribute 
Eo and Value FE. Then the unit-property D-(E musesata 
to be semantically related to the three unit triple 
(A B C) if D can be semantically identified with A, E 
Cane ber semantically ideéntrived with B, and F can be 
SpemencucaLy VOentloicdewitneG, and if D does not contain 


Biya Ove tiles witch)  COntLadict. (BC). Two properties 
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(2B2@ Bande (Gal )are  contraql cronvy it (1) B and G are 

Dn omoaniemUlecarn ia) mCuandet matwerdd 1 erent unvts: and 
(111) C and H are not connected via a superset chain. 

For example (COLOR RED) and (COLOR BROWN) are contra- 
dictory properties. For convenience, the superset chains 
used in finding semantic relationship are assumed to be 
aeeMOstecehree Units slong. Plies chee 1S 7a Uni t=property 

in memory which is semantically related to the current 
Eriple, chestcriplemismsatla ton bessemanurcally well-formed. 
(Peele sem seiOsUnlEOcODehtVESCOmLeLaced tice euLplLe is 
semantically ill—-ftormed, in which case it is flagged. 
MUSE goes on to the next triple regardless of semantic 
well-formedness. 

After MUSE has processed every triple in the current 
SeLRORELLIOlLeSs eit checks fou any flags indicating: the 
existences on semantically am Ii-formed traplesmin, Ehevset. 
If there are one or more semantically ill-formed triples, 
CnemcurrentecandidatesCombinglLoneis COnSsitGered to be 
Uoce bateamtOstLicmmenonyeandmiussre jected, ab. least for 
ENemDECeen eas pa spOscctDlesmeaning tor thewinpul. | However, 
the candidate combination could possibly still be valid, 
especially if some new concept has been defined in input, 
SOmEnesnicde eplacesmenemcurtentetriple Seton a stack of 
SrUlcCemehorucal COmcitplewmmstack.. This Stack is arranged 


TiporOecreOLesmos Galikely = setsmor triples to least likely 
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SoCo ea Mylo sond et smcruncavedwat -eiree such sets, 
Bice lessminsely droppinguorteror tie more likely: 
Orie sete OF@eriples s"saidmto be “more likely” than 
another set if it contains fewer flagged triples; 

if the number of flagged triples is the same, the 
set which was defined first is considered to be more 
iikely. ""Atter stacking the invalad “tuiple set, MUSE 
goes back for theinext candidate combination. 


The “ruff chase volkswagen." example has yielded 
one triple: CRUPE 29CHACE l= VOLKSWAGEN); MUSE “now tres 
to find out if there are any memory unit-properties 
which are semantically related to this triple. Since 
Pepeomunice nye tid thereslscma UNnlteproperty even=remotely 
related to "a band around the neck" chasing a volkswagen, 
the model will likely find no semantically related unit- 
property and will reject (RUFF2 CHASE1 VOLKSWAGENI1) as 
beuniguesemantically @il—~rormeds  fhus, syntax has led to 
the rejection of the candidate combination 
RUFF3,CHASE1,VOLKSWAGEN1; and semantics has led to 
the rejection of the combination RUFF2,CHASE1,VOLKSWAGENI1. 
Tiew triple (RUBEZ CHASK I VOEKSWAGENI) 91s now added to the 
failed triple stack,and MUSE returns to process the only 
remaining candidate combination RUFF1,CHASE1,VOLKSWAGEN1. 
Eventually a triple (RUFF1 CHASE1 VOLKSWAGEN1) results, 


WhLCih Le tested for Semantic well-formedness. Recall 
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Chate Coesconcept, ol migure, 2. lois stored in the semantic 
memory, that is the memory contains a unit RUFF1 which 
Wace ivompronerty. (CHASE CARA Pe It issclear that, the 
memory unit RUFF1 can be semantically identified with 
Ghee DLE Unt RUPFA ; being the: same unit. . Also the 
memory unit RUFF1l has a property whose attribute CHASE1 
is the same as the second triple unit, and whose value 
CAIs cs Onmthe Superset, chamn of the whird triple unit 
VOLKSWAGEN]. Since there are no contradictions, the 
memory concept shown in Figure 2.1 is semantically related 
to the triple (RUFF1 CHASE1 VOLKSWAGEN1), and, hence, the 


triple is semantically well-formed. 


Output from MUSE 


Once the model has discovered a set of semantically 
well-formed triples, it assumes that it has discovered 
aneineecprecati1On sfOLeticeinput, and it prints 
"THE INPUT CAN BE INTERPRETED AS FOLLOWS:". The 
English version of the interpretation is now printed 
Oucymaceomp lL ishedeby steplacing cach unit in each triple 
WielhmeLesmoscOclated Gi1chionuary entry. On “each output 
Piiemiomon Mie ecowd ate LDlomtollOweduin Dracketssby the 
UnLte-peoperty that is semantically related to the triple. 
This gives the monitor a better idea of how MUSE arrived 


AiImcomiicerpretaciOn ss slossurther help theymonitor, 
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each word of the output has appended to it a number to 
show what meaning of the word has been chosen (such as 
PUP enUbee, OL” RUFES). Or eCourse, the OCULpUL routine 
must.take special care to indicate the subset-superset 
Pelae@onsnipeaerined byatWworunstatriples. Tt does this 
by inserting the words BE and SUPERSET-OF in the English 
CULDUL sae lnUs, LOL exanple. itecnem tWOr Unit triple 
(DOGIBO RUET mi seg iven@eOstenesoucputmrouULine ats prints 
eRUPE LP BE DOGL (DOGISSUPERSET-OF RUFEL).% The “ruff 


chase volkswagen." example would have output 

"THE INPUT CAN BE INTERPRETED AS FOLLOWS:" followed 
on the next line by "RUFF1 CHASE] VOLKSWAGENIL (RUFFL1 
GHASE IT] CART) 2. 

TEeeshouldsbe mentrOoned atethis point that’ Lf the 
model finds no semantically well-formed interpretations 
Or thewinput, ie Unstacks =the most likely triple set 
from the failed triple stack, and assumes that this is 
PimeicorpLetalLlOnmEObetie@inpUL a Lilcece tals pin ted 
out as above, triple by triple, with the difference being 
that no unit-properties have been related to the triples 
meaning that the brackets behind the triples (except for 
two unit triples which define subset-superset relation- 
ships) are left empty. MUSE indicates its uncertainty 
about the interpretation by preceding the out with 


Tienhie NOL SURE BUY L THINK THAT" and on the next line 
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WoOHw SINDUT SCAN BE INTERPRETED WAS FOLLOWS:". This is 
then followed by the appropriate triples and empty 
byackets wm for example “RUFF2 CHASE VOLKSWAGEN] ( ).". 
MEOUeLtoDOlnt On, ane worocescing Of an interpretation 
from the stack is the same as the processing of an 
ordinary interpretation. 

After an interpretation has been printed out, 
RIE GibWoyss “eleveurakia) qalniehe che The! GicUieWel.  “Uetitcepeake cnetes 
U1S THIS A VALID .INTERPRETATION?" and waits for a "yes" 
or "no" answer from the monitor (actually the model 
tests for "no" only, so any response not containing 


NOwEUSeCOnNSITOereC LONDe saLtirmeacive). VLE sthe answer 

is "no", the model goes back and tries to derive a new 
interpretation, either by processing new candidate 
eombinations Or, 1f none of these are available, by 
unstacking more triple sets from the stack. When the 
model has exhausted even the failed triple stack, it 
assumes that no interpretation is possible and types 

Lt CANNODSUNTERPRET THE INPUDL. and sthen “1 AM PROCEEDING 
TO THE NEXT STATEMENT.“ before returning to get a new 
input sentence. 

However, if at any stage a valid interpretation 

Rom Guna MUSE asks sthesmonitorn "DO, YOU WANT THIS ADDED 
TO MEMORY?". The monitor once again responds with either 


Gm e> OUR One eh aL DC lanswerei Ss nos, the model goes 
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One to eie SeC-—ectionim portionsor the: program, making 
sure that the memory files are unchanged from their 
state before the sentence was entered. If the answer 


is not "no", MUSE adds the new interpretation to memory 
before proceeding to the C-actions. 

Adding an interpretation to memory is not a 
Cor erenltie task since the triplenotation is iso com- 
patible with the memory notation. MUSE once again 
pmececedsSmEromelett, LoOmGighty processing seach Striple 
Pec UC Cte Ciena lomi Seas EWORUnLumEG ep le, aSay AsO IC) , 
B@uswadded=torC as the superset of *Ciunless *C already 
has a non-null superset, in which case it is left alone. 
Hence, new subset-superset relationships can be defined 
iMeIneNOny w= pliethe triplewis*agthree unit triple wsuchvas 
(AmBeC)) cine smodeleadds ‘thesproperty with attribute B 
ancmvca hic. GCRcOnLhe spLOpeGuLyaruees Ampointerstoe(B Ce) 
is then attached either to a memory unit or to another 
property, which alternative depending on the position of 
ME Neekeomnirse tiiplesinewhichyitthas appeared! (ive. A 
might have occurred in an earlier triple than (A BC)). 
Li Amodias bwappealcomas stiesitarst, Or third velementyorf, a 
triple, then A represents a unit in the memory notation 
ande (BaGymts pointed tomas asnew property of the unitiA. 
However, if A first appeared as the second element of a 
Gripleyesay (fh AWD)7Pthensitvhas already been*derined as 
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(BAG) MiUcmtnemstbprepertyvotmampcoperty, noteofvarunit. 
Hence; mcupOincecEetorthesproperty MBLC) isvaddedito the 
property (A D). In this manner complicated subproperties 
can be built up by MUSE as it processes each triple in 
Lhesuelationaletriplesnotation.= Otecourse, checks are 
made so that duplicate property pointers are never added 
Oka UNnVYELor property. JAlso, “i MUSE hasediscovered a 
new property which is identical (same attribute, value, 
and subproperties) to a property already in memory, the 
new property is not added to the property file, and all 
pointers to the new property are changed so they point 
to the property already defined. 

POL example, if the velational triple notation 
consists of the three triples (ROVER1 CHASE1 VOLKSWAGEN2) 
(CHASE1L DOWN1 STREET1) (VOLKSWAGEN2 COLOR1 GREEN1), the 
following procedure is employed to add the concept to 
memory. After the property (CHASE1 VOLKSWAGEN2) has 
been added to the property file, a pointer to the property 
MemaCpenaed FO tic UnltenOVER since ROVER first occurs 
imthessirst element Ofva traple. Next, (DOWN1 STREET) 
is added to the property file. (DOWN1 STREET1) is also 
attached as a further subproperty of (CHASE1 VOLKSWAGEN1), 
Brice CHASE] first appeared as the second element of a 
Pie luce iicil y jeu ompiIsOpemey (COLOR L GREENL) aber 


beimgecdged, tO the property file, 1s pointed to Erom the 
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unit VOLKSWAGEN2, since VOLKSWAGEN2 was first seen as 
Cisse Cece lenient of aatmiplem sain thes"xsutt) chase 


VOlsswagenme example; srecallethat the triple notation 
is (RUFF1 CHASE1 VOLKSWAGEN1). MUSE would add the new 
property (CHASE1 VOLKSWAGEN1) to the property file and 
WOMLCseeie ln Ste UDsas DOANntLemE LOMEnes property from the 


Ui RUE ens, RUEP I enow hassnowsproperties ; 


(CHASE] VOLKSWAGEN1) and (CHASE1 CAR1). 


Movror AGcLons in) MUSE 


MUSE has now arrived at the “C-action” portion of 
Bese EOces cing mee lle™C-acttOons sare  EReumotor actions 
Cie eee Omimmse WlamLacksS eslCilmaci ial tamgeecc. 
Generally these=~actions are associated with units that 
Can be used as imperative verbs, although the "equivalent" 
HO mero CULonsma GOs Ol Ot BthaveVvabicty ea. betore looking 
for the existence of C-actions in the interpretation, 
however, MUSH £irst aesks "DO YOU WISH ME TO ACT, IF 
POSS Eerie elite cNemanswemel CuEnOn wathe mouel does not 
aoeeipumaiyec-ACLIONGmandsveturns fOr amew input 
sentence. If the answer is not “no", the system looks 
POC ae Cie OnS s 

MU SheoLos te LOOkSmLOsGcCemI: “PU is “the punctuation 
at the end of the input sentence, If it is, the model 


-assumes that the interpretation which it has given the 
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iipUtecCOntatnc alli the antormation required to answer 
the question which has been posed, and points out 
Utter NeWwER 10) YOUR OURSTION WAS GIVEN ABOVE.” before 
proceeding to the next input. Notice the implications 
Clee UsmacCelon: m@tnatMUommcOltalns snOsexpDLLCLt ques t1on 
answering routines; it merely uses the interpretation 
processes already defined. — Thus, MUSE can answer “who", 
"what", "where", and "when" questions only if the 
2ppLOpblavewalcwerelomomsUlDSeL Om tne suwis sword, § For 
example, if the system knows that "john have volkswagen.", 
and if in the semantic memory JOHN1 has superset PERSONI, 
and PERSON1 has superset WHO1, then the system can 
correctly answer the question "who have volkswagen?" 
DyescUbs uc n nomUOHN Mosman Candidate sunt Lome whos. 
Similarly a "yes-no" question such as "john have volkswagen?" 
will not be answered yes or no. Instead, it will be 
answered by the interpretation "JOHN1 HAVE1 VOLKSWAGENL" 
if the sentence is true; and will be answered by 
JiCeCniVO Cet NOE RD Ri Te Hoe iNPUIN sel rethessentence 1s false. 
ThesC-acc1Oon associated wich thes s?y only confirms that 
Amo es el OnenasmDeen acskcur mw Ltsls supstor Lie monlton to 
find the answer from the interpretation. 

PaVUSEMiASss sOUnCENOM—M searaCl TON); Lt takes meach 
Cen om mone) OL LICmINUlLpreolaltlOon aid 1O0kSsiror the 
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Pat homer iNew cystomurinosmsichean action, 1t checks 
Osseo Cm LE tCNeraCceLOuU Satie equivalent” action. If 
SO meneumoce lo prints. EOULVALENCH DEFINED." and transfers 
control to the appropriate routines. The "equivalent" 
action (at present associated only with the unit repre- 
senting the English word "equivalent") assumes that unit 
A and unit C of the triple are to be amalgamated into 
one unit in memory; that is the model removes unit A 
anlcmCOnsOlLVdatesSe le aEDCOMUIIUtC EG. ma Nes acrton rirst Changes 
the dictionary so that the word associated with unit A 
Vielen OmLOnd ee DO mtn COs VUE DU GeIns toads tOmUnt tr GC. 
All. properties pointed to from unit A that are not 
elimeagveOchIincdsundereunit Creare then copied to C. The 
action then removes the unit A from the semantic memory 
ancmc@angesmeny spDO1nlLerSetOmUnIteAsCONDOLNtCerSs toeunit: C. 
This action is used to amalgamate different English words 
which mean the same thing, such as, for example "ass " 
and "donkey". When the "equivalent" action is finished, 
MUSE asks for new input. 

DeiOmnedtUi Valenti edctl Ones tound, MUSH Looks 
for the so-called "imperative" actions which command 
thesmodelsto,cao things. sihere are six, of these actions: 
ie oe Uc eer Lic mea esCri Dew, | Cchandel, and 
"update", each associated with the indicated verb. The 
modelewissl Onlystranster control to the appropriate 
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Ores emer Neosands (iar) tether iixrstirinit of mhe ériple 
is SELF1l or has SELF1 on its superset chain. Hence, 
Bhewerivplem(SEUPI ALT I PROCESSING.) wills bexactedmupon, 
whereas (SELF1 EAT1L CAKE1) or (PERSON1 HALT] PROCESSING1) 
palibiaiioeebemacted Upon sy iiemsix imperative" -C-actions 
will now be explained. 

The "halt" action performs the same processing as 
chev Vsitop “andiistone” Hasitweiut eacmcescuibedyearlMerdn 
the chapter. The action stores all the memory files, 
prints "THANKS FOR THE CONVERSATION." and then stops 
processingss They’ quits actions is) the: samevas theli!4+" 
Past aexiteetiat S,the model’ paints, “THANKS FOR THE 
CONVERSATION." and stops immediately with no storing 
of memory files. Neither "halt" nor "quit" pay any 
aecemialonstoywhatethesCaunit aneithemtraple as;osoi that 
miadtmcake. sO mmuse) Guilty chy ingseewouldrstililoresult 
in the action being performed. 

Dies ideranciactlonems isamipvarmcbovLheliiyeesaction 
Mite Caeice See aed Nil yaias CUMny faction... ehe? action 
simply types "THE CONCEPT HAS BEEN DEFINED." and proceeds 
EOpunicenextaninputer | [hism use becausésMUSE, has@already 
added any new concepts to memory as part of its com- 
Prehensi one process@and ,mchusyeneeds@to perform no further 
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some syntactically correct way is needed to add a 
Single word to memory. For example, if the monitor 
Wanted toladd thesword "dog" to memory, he could’not 
just type “dog (n;)." because the input would be 
ungrenmatrcal;Gbutihencouldstype Ydetine dogi(n;) 2" 
and have the system understand him, since the sentence 
isesyntactucallyecorrects 

The "describe" action is perhaps the most interes- 
tmngtoft tall thesC-actionss= Tt is used when» the monitor 
wants to see an English version of the memory's concept 
Ob tsomeqwocdseenhe actionmlocksiup thes¢€-uniittol the 
(AEBOC)} GG plegtin, thesivlesaot huniits, collecting, its 
Superset and all its subproperties. These are then 
translated into English and the unit and its superset 
are printed out, followed by each property separated 
byecommeas 2 tifethetunite has@nowsuperset Tonwnoe Iproperties, 
these arennot printed@inythesgoutputs “Thus, thesconcept 
fou RUPP Ea(which now hasm®thesinewreproperty —(CHASEL 
VOUMSWAGEND seas twelleasm@the told (CHASE ISCARL))) could 
Vespuilced GULebyEtypingm describemruLin Ttotwhich MUSE 
would respond "RUFF1 BE A UNIT IN MEMORY." followed on 
the next line by "RUFF1 BE DOG1: CHASE] VOLKSWAGENI, 
GHASEISOCAR | jim. mmeAnver perlorming the vaction the medel 


returns for a new input statement. 
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Inemrinaly Eworactions si:change™ and "update" help 
cChesmoniator to perform various editing tasks on the 
memory files. These actions key on the C unit of the 
Ci bonmwatcime Decl flesewitcieriule: 15 torbe “changed” 
Or “updated”, but if no specific file is designated, 
Ehewmocdelsautomatically starts at the dictionary file. 

Tf the action is "change", the model attempts to 
edit the particular file specified. The system asks 
Coo eOnLCOLeLOUSpDeCLEVEWial WOLrd,sUlit, Ol property he 
wants to change (depending, of course, on what file is 
being acted upon). The model then types out the old 
definition of the particular item being changed, and 
asks the monitor to type in a new version. After this 
has been done, the model asks if there are any more 
items to be changed from the current file. The monitor 
responds either with another item or, if he wants to 
Cina WC m en Chim nudes m*Oetiic models that 
the current file has been changed sufficiently, so the 
model proceeds to the next file (in order dictionary 
Giloowmuntumrl |e me DLODeLL yal dele) Bandvaskseif that.» fide 
Temtoebe changed. | Invs process continues until the 
Chong tnjeOrm ener pLOpelr Lye rm LcCrismrimicned,, whereupon, the 
Modeieacks thes monitor “DO} YOU WANT) TO CONTINUE CHANGE?™. 
If the monitor answers "no", the model goes back for a 


new input sentence; but if he does not respond with a 
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no", the "change" action is repeated all over again, 
Sc CeniojawlcleciesolectLonanyertle. Note that the 
syntax file cannot be changed (any attempt to do so 
results in a message from MUSE), due to the way it is 
defined (see Chapter IV). 

The "update" action adds new words, units, pro- 
perties, and parse trees to their respective files. 
LE worksSsin a manner similam sco ichange., cycling 
through the files starting with the specified file 
and continuing, untrlethe syntax file has been updated. 
When processing a file, the model prompts the monitor 
BOmecaCh paces Ofm Lic a Lemetos be updated , anduonce .ageain, 


a response tells the model to proceed to the next 
Bile.meoatee -thiemsyitawert te Nas been sacted Upon, the 
model queries “DO YOU WANT TO CONTINUE UPDATE?". As 
before, a "no" answer sends MUSE for new input, anda 
non-negative response starts the update again with the 
CucuLOnary faker 

ie MUSHMCantehindsno factions, "as Gn ethe (RUFF I 
CHASES VOLKSWAGEN) triple it types “NOPACTION POSSIBLE.” 
and returns for a new input sentence. More details of 


PiUSEeiaidecs Sainpler mun will be given in Chapter IV where 


the implementation of the model is discussed. 
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CHAPTERS LV. 
IMPLEMENTATION OF MUSE 


Introduction 


MUSE is currently implemented as 1172 line SNOBOL4 
program running interactively under Michigan Terminal 
System (MTS) on an IBM 360/67 computer. The details 
of the program will not be given here, but a sample run 
will be examined in depth. Before this run can be 
understood, however, much needs to be explained about 
the data files which MUSE uses, the initializations that 
the program requires, and the machine response format 


which has been defined. 


Dataseiles an MUSE 


MUSE uses) four files containing its dictionary, 
units, properties, and parse trees (see Appendix I for 
examples). These files, each defined as a separate 
line file under MTS, have been called respectively 
DICTION, UFILE, PFILE, and SYNTAX and have many simi- 
Jarueves., Atvthe front or every -file is an integer 
Sbavindg sthesnumbern of Vtemswin the file... Items (i.e. 
words, Ones properties, or parse trees) are separated 
Dye peElods mandecach lle ntermimates with a colon. 


These files can be updated or changed using MTS' 
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editing features, or they can be revised using proce- 
dures in MUSE itself. Any new words, units, properties, 
OG patseseLeeccethat ave defined Using the procedures of 
the program are added to the front of these files, so 
that when MUSE iS interpreting future input, the most 
recent items will be tried first 

DIGIIONS ssther files whvenmeontains che dictionary 
FOUMMUSE in thts dietvoneary are all Ene Hnglish words 
which are defined in the system, plus pointers from 
eacheWwOrdstonCerlLesponding Units an UFILE. “A typical 
emo Onme emotet Onan ymiluCittnbem se Ao lyme Ue 7 eU aye Wen) 
ert Odsecel Ineating, Ene beginning and end of the dic 
tionary entry. The word"fast" has two meanings in MUSE, 
one represented by the unit U22 and the other by the 
UnteeU2een FOL convenrence these,are called FAST2” and 
FAST1 respectively, where a larger numeric suffix 
indicates more recent definition. 

UFILE, one of two files which make up the semantic 
MemocymLOreMUGE, =COntainsmeallethe units wiich, are pointed 
COmEEOM ED LCOION, mA scyDtcaleund Cals sU 22, thes FAST2 unit, 
whose UFILE entry is 22; Dyn leo er Oy se Ne far st 
element, U22, 5) tne NamesOrethe unit. The second element 
Mmenismcase fb, lS) thempartwot Speech symbol encoded as 
Colne io ein Ol OU ee mGOGEOLOnOUn, V1 LOL Verb, b LOL 


(i some GO eb LOLEaCveL Oy mUmEOLecUJeCtlvVe, R tOn allicie, 
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DP oetoureposrcron,, | fompinterjection; ‘erforerelative 
Re nouey adm ecOortCOserc imate: conjunction Al lheunext 
element sobtthemunit thas “ehemactions’ whichare associated 
Witt amchem unit Mein thd Siicasenns: @FAl SSA2 andiA3Knstand 
fore fe feuase, second) srand sti rdwAsactions: AIB1 tand .B2 
dpe seiewe estyand, second sip—acti ons. andGis tis tha lite, (C2 
UoeuUpda vey sloMmilssequiveakentymc4aicethe s5.actrvon, C5 as 
define, C6\is describe, C7 as quit, and C8 is ‘change. 
Ormky Zoneact ion tirom eachic assim (A AiBftand C)ias aliiowed 
Deis Ut seach amunites lasmno actions’, the space “is 
bert. empty. #8 U2S anwthemexample as ‘thexpointer to the 
unit's superset, which happens to be the unit SPEEDI. 
Teas unit whast nomsupesset, vlers assigned) thernul Wtsuper— 
Sets UO Sel fia newaeuni hasbeen “defined on-line’ by “MUSE, 
a superset called UA is temporarily assigned to the unit 
to mark the unit as new. After the input sentence con- 
taining the new unit has been processed, the UA is replaced 
by UO or by a new: superset derived from the input. The 
final section of the nists contains pointers to modifying 
subproperties which are arranged in order of recency and 
are stored in PFILE. In the present unit the property is 
Pore Ghemnn Wirproperty = desined forvall unitsiwith no 
modifying properties. 

The other half of the semantic memory is contained 


in PFILE. PFILE contains properties looking much like 
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fom lie UL ePOok paewherelPoens thetcodes, indicaeting( that 

Lhacmice thie cixth spropertyeand Ull andi Uleare pointers 

to units representing the attribute and value of the 

property. After the attribute and value come pointers 

EO, an yecUGLher. SUbpLOperiates peandsiemtherejarepnoney, 

as in the current example, the null property PO is used. 
The syntactic component, of MUSE is stored in the 


SYNTAX file in entries which contain the parse trees 


for various sentence types. Such an entry might be 
2 (2) VUE seNPVEBDREIC Jets] ZO; Vle-eV lee Zl, &Z9—--* ewinaich 
will parse a sentence such as "halt processing.". The 


brackets contain the number of words in the sentence 
type, in this sentence 2. Immediately following are 

the parts of speech (separated by commas) which are valid 
for each word of the sentence type. In the example the 
first word of the sentence can be a verb or a linking 
verb, and the second word can be any part of speech. 

By allowing more than one part of speech for every word, 
more generality and flexibility is attained. 

The stiicdselementeot tne SYNTAX entry, starting 
Steuiceoluscmesi1 gn and) COMEInUING Until the period; is 
PieomvaboemtLCen Lom cle esenuence, tyoe. The papnse tree 
Herearseol-e20,)Vl— Vives 22-4" The tree is described 
from the top down, each element (such as Sl, ZO, V1, etc.) 


representing one node of the tree. An element preceding 
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emoelieca Ome cuChieaswo | bei smtheahead of a branch pair, 
and the two elements following the semi-colon but 
preceding the minus sign (such as ZO, V1) are the left 
and right branches from that head. Each branch pair 
is described in this fashion until the entire tree has 
Dbeenscoced= sthe letter in -anvelement (ave. S, Z, V, etc:) 
identifies the node type as one of the following: sentence 
or clause (S), noun phrase (N), verb phrase (V), adverb 
phrase (B), adjective phrase (D), prepositional phrase (T), 
and terminal node (Z). The numbers after the elements 
distinguish that node from others of the same type (e.g. 
two noun phrases are Nl and N2). The numbers after 
terminal nodes have special significance, however, because 
they represent corresponding words of the sentence type 
(ie eS Chem UCSLEWOLG Ol the sentence type, 22 the 
second, and so on). ZO is the null node to be filled in 
Hacer by actions suchas AZ and A3. 

ViemodL Se meGgecms lt meO evi eee Wee Mle 2 ee, Cel Wit 


EsmawelLeecein menoby nOtatton, would look Iikesrigure 4.1. If the 


Figure 4.1 Parse tree in SYNTAX notation 
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PipUEMScMectCem Ss acsumed) tomoe mialt processing." , the 
petsemtrcescould) be translated into English terms as in 
BreurerAe . 
aN 
verb phrase 


gi. 


halt 


processing 


Figure 4.2 Parse tree in English 


In Appendix I there are two sets of memory files, 
the first setoeontaining MUSH's "knowledge of the world” 
before the sample run has taken place, and the second 
set showing the knowledge which MUSE has gained during 
Chess cui lNCwriGSt woe OL ei lesmcontains, several points 
Geb cecest aD GlwWONRCOltatnscmoleadirrerentawords ,. wo 
of which (OF and FAST) have multiple meanings. Note 
EmateeachMacllon words (suchwas HALL, DESCRIBE, etc.) 
has been defined, that the file names (DICTION, UFILE, etc.) 
are words in memory, and that the model has a concept of 
SELF and knows its own name MUSE. 

UFILE contains 33 units representing concepts that 
the system understands. There are two more units in UFILE 


tiaweeneremaLe words 2m DICTION due to the extra meanings 
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for OF and FAST. Both OF and FAST have two meanings in 
INemory represented as OF2, OF1, FAST2, and FASTI1. 

OP2m USO) else theameaning OTe Ore which could occur in 

a phrase such as "color of volkswagen" that reduces to 
triple notation (VOLKSWAGEN2 O COLOR1). The other unit 
POOP Onl a(U20)) Could be used in wvolkswagen of john” 
meaning "john have volkswagen". The two meanings of 
FAST, FAST2 (U22) and FAST] (U21), are respectively 

the adverb used inthe sense "Speed fast", and noun 
meaning “going without food". An interesting feature 
GrmUniiim smtnemtactetiat the unit PERSONT (Ul5) has 
superset WHO1l (U5), implying that question answering 

can be undertaken with PERSON1 as a candidate unit for 
WHOL. The units MUSE] and YOULL (U3 and U2) both have 
Supeccet oLb" le(Ul) 7) indicating that they can be used 

as subjects of sentences which "command" the model. 
Ticeunit SELLE Wehas pointers. to) Six properties, the only 
properties defined in the model at this point. Contained 
in PFILE, these properties are (DESCRIBE1 SELF1), 
(CHANGE THIENG 1) (OULLLSTHING)) 9) (DERINET THING!) , 
(UPDATE1L THING1), and (HALT1 THING1). Note that whenever 
the model uses Preperticsmuaateapply to THING], 1t can 
deduce that they apply to the file names, as well, since 
Led Olam UL) UL bite (ie) fee pE LE (U0 LS), and -SYNTAXL 


(U16) have superset THING] (U14). 
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The SYNTAX file contains 14.parse,trees for 14 
Sen len CemcipeseLiatmaleu  rOMmeLWOuLO eight words an 
length. Because there must be exactly two branches 
for all non-terminal nodes in a parse tree, articles 
cannot be coded as extra third branches as is usually 
done. Thus, dummy noun phrases are devised to contain 
the article, and these are later deleted from the tree 
bygectlons Al. NudLIs branchece( ZO), aresquite common, 
are usually associated with adjective phrases, adverb 
phrases, and imperative sentences, and are usually 
filled in during processing with the help of actions 
AZBOESA Je SUNTcCOsnOLewoOrEehy 1s4the first sentence (of 
Six words), the only sentence which contains a subordinate 
clause (delineated in the parse tree by S2). Many part 
of speech vectors with multiple entries have been speci- 
fically inserted to allow the definition of new words. 
For example, a two word sentence has been designed for 
such sentences as "define dog.", where the second word 
Gangbevany part Of speech. Finally, several syntactic 
ambiguities are apparent, such as the two parse trees 


EOmea cue elOlimwoLld, SenLence, 


The Sample Run_: Memory Build Up 
The sample run is divided into a memory build up 
section and a question answering section, each presented 


jaeAppendix Ll. There are 26 sentences and questions 
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which are handled by the model, to which numbers have 
been added for convenient identification. Input by 
BhesMonLOrs sainesmalleletters ,,outpuL from MUGE as 
capitalized, and all words taken from the semantic 
memory have numbers affixed to them so that different 
word meanings can be distinguished. Modifications and 
additions to the memory during the sample run can be 
best understood by comparing the first and second sets 
Or ri les in Appendixek. 

MUSE is started by typing the MTS "SRUN" command 
shown at the beginning of Appendix II. The $SRUN command 
identifies relevant files and input-output devices and 
initiates program compilation. A successful compilation 
BesUlesm ieee DL NiluggOnstuniesstabemenc . OssYNTACTIC 
ERROR(S) IN SOURCE PROGRAM" after which control is 
transferred to MUSE. The model types "GOOD MORNING. 

MY NAME IS MUSE." followed by "PLEASE TYPE YOUR INPUT.". 
Hes enene watts srOr LNesmonlLtor eto enter ay eee state- 
ment. 

THhegec inst Pence to be processed is "update 
syntex.  . MUSE interprets this input by adding the 
Mipecea stvemsUuDeCEa HM tOstiessentence action AZ), 
ereer which the einputlycan, be wemantically related to 
the memory unit-property SELF1 - (UPDATE] THING1). 


Since this) 1s an interpretation for the input, MUSE 
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Dmiits Olt both the curment triple notatiron of the 
Spencence sand= ats "related unitt-property in “brackets. 
Phew monuvourarrtucms “that the interpretation Ws valid, 
that it need not be added to memory, and that it should 
be acted upon. The update action is then embarked 
upon, Startang at ‘the’ file 7SyYNTAX* since ‘this was 
specified in the input. The monitor adds a new parse 
tree (for sentences such as "Chase means pursue down 
street.) abter whicm ay colon is entered indicating 
that no more SYNTAX update is needed. MUSE, after 
adcingmapproprlate lDcackets;, plus signs, sand periods 
LO wrnNe new SYNTAX entry, tacks the entry Lo the front 
of the SYNTAX file and increments the number of parse 
treesto 154 Since the update action finishes after 
SYNTAX update, the model asks the monitor if he wants 
GOrmeone nuceupcaving = andssimce= he does, MUSE proceeds 
LOUD LET IONSUpdate.s elheamonvuoreentvens™ the new word 
wincecnce wien MUcH adds stor the “front. of DICTION“and 
asstons ene: UNttepOlntremnle Ie "Since theresatemno more 
WworedsetOnbesadded Co tne dictionary, Che model carries 
Cre eoOmTcie ex teUpdace, = ties UML updater Where *tne 
Monucoce entero tie part ob speech =e ¥ the action "bil", 
Eiemsipersel UO p,eand the subproperty "P07, . * MUSE 
Cieneceuss up tie: toweulnd teUs4e(ateche front ob UrLLE) 


to which these elements are added. Thus, a new word 
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"meens" with corresponding unit U34 has been set up in 
memory. = Nextyethe monitor constructs a new property 
(with attribute U10, value U14, and no subproperties) 
which MUSE designates as P7 and adds to the beginning 
Coy TILE ee cince = Lhere are no mew SYNTAX tems, and 
SanCostNesmonl tere does not Wane to continue, the supdate 
action is terminated, and the model asks for new input. 
Notice that the monitor has misspelled "means", 
has added the property (U10 U14) (already defined as 
PS) ees ees dae oa (Ui Us )Perandsiasenoteacdceu™ tiesnew. 
DBOP Gey Basan PLODeT LY mOLmunem lI GSstaunte ohh. | Thus’, 


he now types "muse change diction." and makes changes 

to the appropriate files. The model can interpret the 
npue sincerit knows SELF1l = (CHANGE THINGI); and MUSE] 
Toma SubSeLeor Sule vand DICTION as aysubset of THING” 
Once the change action begins, the model asks the monitor 
to change each file except SYNTAX (since SYNTAX items 
have no unique labelling system as do words, units, and 
properties). When changing an element of the file, the 
MOMtseL ChLerss tne wOrd;sunitt, Or property to be changed, 
the model responds with the old version, and the monitor 
enters a new version to replace the old one. In this 


Mannenm ('meens” 


becomes "means", the property P7 is added 
Ome meno Py. tSechangede to (UI Ul4) before the model 


proceeds to the next input. 
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Fomine next @sentences  spersonm change or le." , 
the model cannot find a semantically related unit- 
Property =inememory, SO lt goes to the failed triple 
Stackeror tne closest approximationetoethe meaning of 
EneceEnpUc. eo lNCe=chismis wa: Valiaminterpretatizon and 
Sprott eacdceCeroetnesmemnory, (Use tasksert tts  to«act. 
PNewnOn COresays = eyes, DUCHNORaCUt1OnMiS poSssip le Since 
MUSE cannot recognize the subject as referring to SELF1 
Sbtany subset oreShunie 

The next two input sentences (numbers 4 and 5) 
add new concepts to the memory. Sentence number 4, 
ate al J coulivalentwtne (Fsal) 14, Snowsethat news*words 
can be defined in text and that the equivalent action 
works. What is contained inside the brackets of the 
two new words is of the same format as the UFILE entries; 
in fact, the bracketed elements are inserted directly 
iicomtne new untts. Hence a -Fvand the "sare both 
CerucleseWrchmunemrarsteA-acr1 Ons wl Nemimportance Ob 
suppressing tie actionssthesfarstetime through®is allus- 
trated fere, since withoutethis suppression,;saction Al 
would have deleted both new units from the input before 
it could have been interpreted by MUSE. Once the input 
has been understood by the model, it is added to memory; 
Ciao EOULVALEN With by ioeaddedras aeproperty Of the 


Hitcoe eer ina liv, "equivalence 1s cerined between Al and 
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Ye 


: ~_ al 
Paes 


Vii diet he 


<> ie 
a bee 


“4 


a 


Ors 


THE] yielding one unit, THE], with. one property, 
(EQUIVALENT1 THE1), which has been transferred to 
THELSiwomsAl. 

pentences> shows the definition.of. a,unit,, a 
superset, and a subproperty all in the statement 
eclosedy; emeansmpursue( Vs) edownil te estreetin, ) .". 
tGpalsow.llustcvates, the reasongfor, the detinition: of 
Enosehirdsconsolidationsrules of stheylast chapter. 
Since "means" has been defined by the update and 
change actions to be the same as "be", this sentence 
is interpreted (through the use of the failed triple 
stack and. the third consolidation rule) an the, follow- 
manner: CHASE] has superset. PURSUE] and subproperty 
(DOWN1 STREET1). The property (DOWN1 STREET1) when 
associated with the superset PURSUE] gives the memory's 
concept of CHASE1, a valid definition satisfying 
Quillian's criterion of a memory concept quoted in 
Ghaptenmelel  (alscomineOQuis) lgan 1969 pages462,). whe 
new units, new superset, and new property are all added 
to the memory, and no further actions are possible. 

Sentence 6, "define dog.", in addition to demons- 
Cobia nCeOSti NeaaACLIONMSLoaGL Ss) OLtE ae SiicldestOLyeabout 
dogseand«Cars which, the_modeleis fed.sentence by sentence. 
Li SeeCOnel ncotmalrtons..carneds in) thisastory thaty MUSE 


answers its questions in the second part of the sample 


a2 


Cun we (eanexteinputy rurti(n; isbesdog(n:)m@that be 
animal(n;)." informs the system of two levels of 
superset ini thevsame sentence, astwellas)defining 
three new memory units. There are two interesting 
pomntsmabouteehis  }statement:m (i) tthemdeletion (of “the 
word "that" by the model when interpreting the input 
(which shows the way it handles clauses), and (ii) 
the fact that the second consolidation rule (amal- 
gamating two unit triples) is sophisticated enough 
DOCmLOMJOlMN .ewoeunit Eurples ofGthe forme(AaO B)MBTO C) 
which define subset-superset relationships. 

Input sentence 8, "volkswagen(n;) be car(n;).", 
defines subset-superset relation between two new units, 
VOLKSWAGEN1 and CARI. Sentence 9 is "volkswagen be red.". 
It has exactly the same format as sentence 8, and could 
be parsed using the same parse tree that sentence 8 has 
used. But this would define REDI1 as the superset of 
VOLKSWAGENI1, an obviously false interpretation. Hence, 
MUSE rejects the sentence 8 parse tree and uses another 
tree especially designed to handle the unit-property 
concept of sentences such as sentence 9. MUSE has thus 
deciphered a syntactic ambiguity. This example also 
marks the first application of action A3 where the 


Superset OL REDI (namely COLORIL) is added to the tree. 


8) 


Of interest, as well, Hehehe use of the second consoli- 
dation rule to amalgamate the two unit triples 
(VOLKSWAGEN1 O COLOR1) and (O COLORI1 RED1). 

Input sentence 10 ("ruff chase the red volkswagen 
down the street.") is the longest sentence that can be 
DnderESEOOdmUSINngmthesecurrent«SYNTAX file. 

There are two parse trees for the sentence, the first 
where the preposition phrase "down street" modifies 

the noun "volkswagen" (i.e. it is the volkswagen which 
is down the street), and the second which has "down 
street Mmodifiyingetheyverb*tchase'"W(ive.Mthescar sis 
chased down the street). MUSE starts by applying the 
first parse tree to the sentence. This attempt is 
rejected in the semantic processing portion of the 

model and its triple notation (RUFF1 CHASE] VOLKSWAGEN1) 
(VOLKSWAGEN1 COLOR1 RED1) (VOLKSWAGEN1 DOWN1 STREET1) is 
stackedgat mthes@topmor ,theitai ledetriple i stack so "The 
second parse tree is now tried and results in the triple 
notation (RUFF1 CHASE1 VOLKSWAGEN1) (CHASE1 DOWN1 STREET1) 
(VOLKSWAGEN1 COLOR1 RED1) which is also rejected by 
MUSE's semantic intersection techniques. This triple 
Sebiis then added ‘to therfarled triple stack, but vabove 
the first vattempt isince Viwo triples* (CHASED DOWNL STREET1) 
and (VOLKSWAGEN1 COLOR1 RED1) are semantically related 


Coumenonry pawhiereas win sthesiirst try only thes triple 
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(VOLKSWAGEN1 COLOR1 RED1) matches. There are no more 
Pocslo emi meerpretaltionc, co MUSE prints oUt »thne first 
Ew lemsetEOnmuneestack, that ws,thne Set associated 
with the second parse tree. This is a correct inter- 
pretation, which means MUSE has resolved a syntactic 
ambiguity by using semantics. 

Sentence 1l, "ruff chase the volkswagen fast.", 
shows how syntactic processing can resolve a semantic 
embiguity. “(Ne wordmertast = Means both “going without 
FoOC wt AST) mand» ssoeedstase  (FAST2),. and without 
syntax MUSE has no way of telling which meaning is 
appropriate here. However, by using the SYNTAX file, 
the model finds only one valid parse tree for the 
sentence, the tree applying to the adverb FAST2, and 
hence the ambiguity disappears. 

MUSE has no trouble with the next sentence, 


"jJohn(n;) be person.", which merely defines "john" as 
being a person (and hence a candidate for "“who"). 
Sentence 13, "john have a green volkswagen(n;).", 
defines a green volkswagen (added as VOLKSWAGEN2) 

Ov cos lyelOGn. se us 7s USE ehessadcded another possible 
ambiguity since it now knows of two volkswagens, which 
SonmOl ye Den cGLdsd pall sbyetiecll COLOLS.. she Next input 


! 


Homutiiis volkswagen be aeCcan also. which has several 


interesting idiosyncrasies. The sentence contains no 


be: 


Ry 


a4 
Vrs) 


5 


less than roe ee Weiss (aah a” Se inten Velicton a) i elnrche 

are inserted just to improve readability and are deleted 
Oia vVerl Ome Lome GOCeSciigebysactton Al. This islalsoutne 
leach e ene of the sample run which the model has 
Misinterprered ,~a tesult Ofethe fact that MUSE already 
knows that VOLKSWAGENI has superset CARI, but it does 
NGO cELMOWeENUuSmia Gra lOUtEVOUROWAGENZ mL nUS, alter L£irst 
trying to match VOLKSWAGEN2 and CAR1 in memory and 
Failing, MUSE stacks s the anterpretation and finds. the 
connection between VOLKSWAGEN] (the other candidate 

UD iO GG licsWwagchm)monOnCARLeWwihiCheli Dailies Out. 
SUNG: TELS WG ileke El elibael ieleehaereiecleoll, ilies Geibietsie iea\y 
is unstacked and printed out, yielding the correct 
comprehension of the input. 

The model now processes sentence 15, "color of 
the volkswagen be green.", a paraphrase of a fact that 
it has already learned in sentence 13. The model must 
choose between two meanings of the word "of", OF2 and 
OF1, and also two meanings of "volkswagen", VOLKSWAGEN2 
Baum OLKSGWACENL mei tECcdiioOtmte ll awhichyieaning is COnreCE 
BOLECaCaVOLOMELOMEs VOwactlcECcOonsilOera bionc, since, both 
candidates in each case have the same part of speech, 
SQRUUCERIIUS Gb USsemtelNeeCOnLext Ot thessentence to Solve 
EnemanbLaoULty 9 (1.6.mccMantlC processing LO resolve.a 


semantic ambiguity). MUSE assumes that OF2 and VOLKSWAGEN2 
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are the candidate units for "of" and "volkswagen" 
respectively (since: they are the most recently defined 
units), then deletes the word "the" from the sentence, 
adds= the superset COLOR] to the parse tree, and breaks 
the sentence into triples (COLOR1 OF2 VOLKSWAGEN2) 
(COOP MBE ISCOLOR 1) (BE IMNCOLORIMGREEN )F. Application 
Ciacci Onwe 4OnuOm2 TandsaBiajonase live ldssttheytriple 
notation (VOLKSWAGEN2 O COLOR1) (COLOR1 O COLOR1) 
(OF COLOR IMGREENI)% twaveh) isiconsoliidated: by tthe lirst 
consolidation rule into (VOLKSWAGEN2 O COLOR1) 
(O COLOR1 GREEN1) and by the second consolidation rule 
Dicom vClh GWAGENJM@OLORINGREENIS)) ) =iThvse triple 1s sthen 
compared with the memory concept already known from 
Sentenicemirgnicn -Cund) tomberscemaiiti Cally tuelatediy rand 
HSMmpIghiteeOyOuL. MiLNusjensoncence m! 5) haswnotwon lyshown 
how MUSE can use semantic processing to resolve semantic 
ambiguities, but ta liso whowsthe model employs (its! consol1; 
dation “cules JandWitsvA “and¥e). actions to understand 
Pacapinascsmaes Note sbadt ethics Bismthesimrst sentence 
Wiete etie mMonulorsdCesmnot want any tactions tortbe 
SoaeenpLen MesOsuleemode WEprocceds istradight eto Pehemnext 
Bip. 

Sentence 16 merely teaches MUSE that there is 
afotne feu acadiled rover Pii.c. mrover(n;s))) beganother 


og MmDUi~mcentonccam (ei cmpechadps ithe wmost interesting 
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and surprising sentence of the entire sample run. 

"cover chase the green volkswagen." states a brand 

new concept which MUSE has never encountered before 
(that ROVER] chases VOLKSWAGEN2), and it seems reason- 
able to assume that the input will be uninterpretable 
except by taking close approximations from the failed 

(le Okey ekeetehe, ihe Se “ebnenel “obhe ‘eiieke “WNBPSNy verchey eheversyexchiersh e\e 
the input directly from concepts which it already knows 
withiouteappeal ingeatomcie: tal led triple stack, Using 

them act etha tmolo tiem. COd,eRhRUBE IL Chases another car, 
VOLKSWAGEN], the model can infer that (ROVER1 CHASE1 
VOLKSWAGEN2) is semantically well-formed. This implies 
that the model has, in effect, generalized the concept 
Mdogs chasegcars strom the specific fact) that "rut chases 
volkswagen.". In other words, the model can learn by 
example. 

Sentence 18 is a sentence which is uninterpretable 
since there is no parse tree for "john chase dog be" in 
SYNCAXP ees entences: 19 mula te processing...) tells: MUSE to 
SLOppandy store its Memory filess (action, Cl), thus saving 
fiemiicOocmallOn whiten the model hasadearned an the last 
eighteen, sentences .,, This, sentence, is, followed, by a 
sample of the MTS termination format which shows all 
of the statistics for the run. The average execution 
time per sentence can be derived from these statistics 


and turns out to be a fairly slow 50 seconds/sentence. 
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The Sample Run : Question Answering 


Question answering is carried out using the memory 
files which have just been built up(displayed in Appendix 
sis Bite eee cd | eciiote quest lONneanswering 2S a Oyo 
product of MUSE's candidate selection process, and that 
action C4 associated with "?" merely activates the 
response phrase "THE ANSWER TO YOUR QUESTION WAS GIVEN 
ABOVE.". Sentence 20 illustrates the type of answer 
given to a "yes-no" question; that is the re-iteration 
Cre cielo pce imc holm nOCi@l nel be1s elated 1CtO,a concep” 
in memory, and the response "I CANNOT INTERPRET THE INPUT." 
if the input is not so related. Thus, when MUSE reads 
"Gar Of john be green?", it can relate the input to memory 
and print gut a valid interpretation which means the 
answer can be taken as "yes". Note that in order to 
correctly answer the question, MUSE has to substitute 
VOLKSWAGEN2 as a candidate for "car", and must solve the 
semantic ambiguity caused by the two meanings for "of". 

Sentences 21 and 22 show how candidate units are 
SVoStLeuLed LOolrt Wao mandsswhate to yield accurate 
answers to questions. In sentence 21 ("who have green 
volkswagen: ) MUSE first tries WHOL and PERSON] as 
Gandidate units for “who”, but a sSeihantic relationship 
to memory is found only when JOHNIe?s: substiavuted. The 
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interpretations (since there are four candidates for 
nwo) eels GOLOR LT» GREEN le and eREDJ: and three 
candidates for "car": CAR1, VOLKSWAGEN2, and VOLKSWAGENL) 
which are generated, tested, and rejected one by one. 
One of the interesting combinations that is rejected 

is RUFF1, CHASE1, GREEN1, VOLKSWAGEN2 which becomes the 
triple set (RUFF1 CHASE1 VOLKSWAGEN2) (VOLKSWAGEN2 COLORI1 
GREEN1), the first triple of which is eliminated because 
it contradicts the memory defined unit-property 

RUBE Wie (GHASE IS VOLKSWAGEN D)i SSimianiky RURRL, CHASEL, 
GREEN], VOLKSWAGENI and RUFF1, CHASE], RED1, VOLKSWAGEN2 
are rejected because of contradictions. Finally the 
candidate combination RUFF1, CHASE1L, RED1, VOLKSWAGEN1 
Pomobiraeneds @elhiisuslS SbOundstoebe isyntacticallyyconuect 
and breaks into the triples (RUFF1 CHASE1 VOLKSWAGEN1) 
and (VOLKSWAGENI1 COLOR1 RED1) that intersect with the 
unit-properties ROVER1 - (CHASE1 VOLKSWAGEN2) and 
VOLKSWAGEN2 - (COLOR1 GREEN1) respectively. These two 
intersecting unit-properties were chosen by MUSE because 
they, aceesemanticallysrelated tosthe triples sand.are 
more recently defined than RUFF1 - (CHASE1 VOLKSWAGEN1) 
and VOLKSWAGENI1 - (COLOR1 RED1). A true question answer- 
ing procedure would have looked only for the last two 
unit-properties and would have discarded all others. 


Thus, MUSE has correctly answered the question, but only 
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by using inappropriate unit-properties, a fact which 
truly indicates that in MUSE question answering is a 
by-product of finding semantic relationships. 

Sentences e 723,624, and) 25sare examples of the most 
inceres tang Cpsaction, the describe action (C6). “the 
command "describe ruff." is interpreted by MUSE and 
is acted upon to yield the output of sentence 23. 

Of interest is the lack of commas between the property 
(CHASE1 VOLKSWAGEN1) and its subproperty (DOWN1 STREET1), 
and similarly between (CHASE1 VOLKSWAGEN1) and 

(SPEEDI1 FAST1). By leaving out the commas, MUSE 
indicates to the monitor that this is a property and 
subproperty, not two separate properties. Commas are 
inserted to distinguish between different properties. 
Sentence 24, "describe chase.", shows the importance 

of having defined the third consolidation rule to handle 
sentences such as "chase be pursue down street.", since 
Edcw plait -GULSOM LNesmemMOrny, sos cOnCept Of. 'Chase, is the 
same as the English input which defined it originally 
(SGeemocnilences uOhetcheesdmlp leer Ul). lheanext 1nput 
"describe red volkswagen." shows that the describe action 
does not need to be a two word command, but can be 
designed to employ all of the model's syntactic and 


Semantic powers to decipher the input. Hence, MUSE 
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chooses the correct (meaning yfior “volkswagen" from context 
ance vertormoetnoudesce1bevaction on this valid interpre— 
tation. Not shown in the sample run are describe actions 
applied to units with no supersets or subproperties 
(Gr CrmOe Zs oeinted. oul eas vOU2s BETAS UNID IN MEMORY .")) 
Omer eae per se sot snOusubpLoperties (2.g.. THEI) printed 
COteacmeli nh eb ke Ag UN DT SI NeMEMORY  eROULVAGENT |. THEIL, .%). 
mMie@einalwsentencestellscesMUSH to quit processing." , 
BiatetsscCOeSslLODMWiLleloOUuesctOling any Or the Memory, Liles. 
Since the question answering routines and describe 
BCUTOnSBOLME smo CelOlNCOMNOLEaCd —Any clang ClO UMemMOLry, 
NOeLOsSseOUslnrOrMarlOoneresU les from Gquitting rather than 
halting. The statistics summary shows that question 
answering has used up a significantly larger amount of 
time per example (94 seconds/statement) than did the 
memory build-up sentences of the previous section. This 
is due mainly to the larger number of candidate units 
needed to interpret the input. Further considerations 
of time and space constraints will be included in the 


next chapter where an evaluation of MUSE is undertaken. 


Cae - ’ any ri 
a ey = 7 a Ie 7 s 


wii + 4 4 - * 7 ra | or 


| sbinds ‘moyi “agpewabibaw? tor pe tutiont 
~ormg soit bitsy ett ne Aoids6 at opi ree 


ae ee 
is at. 


ahiok sex sdtasaeb S15, Fad tae Signe sat nt uate gow 


pe fINe syo dda IO Bene giS: on iste ask ood 


. 


(2. 9I0KEN WI-TTa A 1a-S40" ds duc Sotnkag Rae 
botniag, LS? «pb. | asttiagoisdye orn Fie oo agp! & we 


; > 
i nae or irre ~. eo ‘ " 
oC, FSR? LIM AVIUOY  2YAQMEM WT SIG) WA aes IA, RR, 
- * ’ . y 5 7 ; 
pdivesnoig J twp” ot caum eliet eoteinge: Lanes oat 7 


. le 
‘ pettas yeamem: oft Do Yrs “pis1oese IUOAD EM date oF ei as . 
oe act aoe) Bas 2snsvot nattevents noi sees “Saks ee 


yranmen od paiditene Sbs Joaob (opsaSe. 2hag to. 
x . we 


A 


(en? abnse: pridasiop moti. edgises} a ite is nraznd To esol « ° on 


& . ——. - Ae - a ; aT is = f 
hoOtieuyp thc ewone. yrhmin aak3 2 bite’: 2. si? 
“A 


1o. tevome. xopzel visnsottinete 6 qu Gse0 earl ee 
‘ , : a af ~~ ' -on 

Site br ster taomei ste ebnoose D2) aii 14e> 2 
eroit” vaiGotgoess 2voryoud old 2o asonsesres QHehe zsid 3 


asin. ssbbtbnto to tocmen, sspysl sit oF wth “bn '. . 


@notisxabienoo tadtx0% .dugqal edd, dexoiaiod a hebeon 
; F ‘ ‘ y . a. 
Sid mir bobuioni« sd Iitw, shriieysedos SOPaR a ‘omae 3. 

- 4 7 7 oe @? 7 

A » 
retest ‘obey as fen io) mor Leite SVS 86 Sionw sedysila 
. ‘ 2 _ , ‘ 


e 7 


MT 


| ae 


bi . 
f 
Lh ib 
: ‘ 
i 4" 
a @) a 7 
a. 
i 
" 
: wv cad 7 i 
1 - a - i 
7 ne ee ae eee | 


102 


CHA PIER av. 


EVALUATION OF MUSE 


Strengths and Weaknesses of MUSE 


Bhempurpose ofthis ichapter 1s to analyze the 
SEMuiclunchore MUSE; pointing Out the strong parts, 
describing the weak parts, and proposing some improve- 
Me nismtomene modelye MUsheiasspcactucally no limitations 
of subject matter; that is there is no reason why the 
system cannot process information on as many different 
topics as is desired by the monitor. The model works 
Deteermenatunally,, tre ttseuniverse Of discourse has a 
small vocabulary, and if as few words as possible have 
multiple meanings. 

Although the input to MUSE is very readable 
English, there are numerous restrictions to which it 
must adhere. These restrictions are imposed mainly 
to enable the easy translation of the input into 
Le Vabrvonal@trri pl eqnotation,. and itt would not be too 
difficult to eliminate many of the problems through 
the use of more sophisticated interpretation procedures. 
Thus, routines could be designed to’separately handle 
each word of a series of words joined by conjunctions. 
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processed as the two sentences "ruff be dog." and 
"rover be dog.". The handling of modifiers of modifiers 
(Suchtastivervwaiin s very little -dogi)) would not be 
difficult since in the memory notation such modifiers 
are just subproperties of subproperties. Special syn- 
tactic procedures to handle suffixes, tenses, plurals, 
agreements, etc. could be implemented by associating 
in some sort of table each such modification of the 
BOOURWOLCGmw Ltn Alien WoRcm LCCC wmeinewaddition, MUSE 
could be expanded to include subroutines which would 
derive information from such items as internal sentence 
punctuation, capitalized words, and quotation marks 
around words. Reduction of sentences with intransitive 
VELOomeo srelationalmcyal ple snotattonsisimoreldilEficult. 
To 1Sseeawhy.penotesthat thelsentence Yruff runsfast. 7 
could be coded as the property (RUFF1l RUN1) with modi- 
By Ung BSULOL@DeKt yan(c CRED IEF AST Ll) Re pBute thissistagproperty— 
subproperty unconnected to any memory unit, and hence 
it means nothing to the system. The question is, 
there sore, stOuwlich unit@inememory wshoulds the property= 
subproperty be added? More work needs to be done on 
this problem before a satisfactory solution can be 
proposed. 

MUSE's memory structure, being similar to that of 


TLEM (Quillian, | 1969)\issasnetwork) designed’ to store ,all 
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MennereOnsdatay “Ihe structure is able to code extra- 
ordinarily complicated English sentences in a simple 
but elegant manner. The semantic procedures of MUSE 
use the memory when distinguishing between fine shades 
Of Meaning. “Much logical ability is also inherent in 
the memory structure which allows for such items as 
SwoeteeiLay sulscete mill callonem vidas subsets (— 71 5e%. 
if A is a subset of B, B implies A), and equivalence 
between words (two words have the same unit). 

Among the shortcomings of the memory network is 
the fact that it is not possible to negate units, to 
GUualeleyeuliteS, MOMm—ECOML PnigsUnTttSs witheOneor. and. 
However, Quillian (1969) does allow such features in 
his model (by adding special markers to each unit), so 
a future implementation of MUSE could be adapted to 
handle these logical elements. Another possible 
deGaveul CVs with cnesmemonyestructure, 1s that it is 
too simple; that is some concepts might have to be 
distorted in order to adapt them to the memory. Indeed, 
Some awOLdspusuchwas ant cles, sconjunetions, and inter- 
jections, have no meaning at all to the system; and 
ways must be found to code such words in the memory. 

MUSE processes its input in a very interesting 
manner. In some areas of input processing MUSE is 
highly successful, whereas in other areas it is quite 


weak. Thus, MUSE makes good use of syntax to learn new 
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Bola Cons moor Orrcetesemantic processing, and) to nelp 
PesOlVe tsceMantic ambiguity, but the syntactic’ element 
Tomes bre ugcoecrlude, Consisting only of a tile of 
parse trees, and even the parse trees are simplified 
so that the system can comprehend them. What is 
Pum edetsed MOreesOpliscicavedssyutactic Component, 
made up of rewrite rules working on more precise parts 
of speech. MUSE supplements syntactic processing by 
using predefined A-actions and B-actions to aid in 
EBalislLOuUMIng thes inputs InLO tne Aanternal Structure of 
the model and to transform different paraphrases of the 
input into the same format. Yet these actions are quite 
eum lOC malay Mig@n DCC LG son iOelLormal theory behind = chen, 
More work needs to be done on the theory behind these 
actions, and extensive testing of MUSE should be under- 
taken with a view to discovering the validity of the 
acCronce 

MUSE chooses candidate units in a way which yields 
elie pCssible Interpretations OF the input; but Ehe model 
should be able to eliminate "obviously" incorrect can- 
didates before generating all of the candidate combina- 
tions. This is necessary to help speed the semantic 
intersection procedure and to alleviate the very slow 
Pevcessing tillieo tide Glow even Longer as themnumber of 


candidate units increases. The model could accomplish 
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this by Ss fergetting’ sunused units or by weighting certain 
URtessandelankceinememoly, according to their use. 

Thaesmodeledoessagtairly good) job of handling 
anaphoric seterences (references to concepts used earlier 
in etext) by coding all input an the same format as ‘the 
MeEMe@byes CLUCtuLe. Then, when choosing candidates, MUSE 
Dicko sche emosterccenslysdetinedmtinitsatirst. Under this 
system, however, a unit will be chosen first less often 
as other units are defined, even if the unit is used 
again in a more recent context. What is needed to 
remedy this is a procedure to cycle units to the beginning 
of the unit file whenever they occur in the input, thus 
ic Ging ste oeCivijtc mlOnmwO hEeClhO1CemicmECCeNCyY BOLNUSC, 
not recency of definition. 

MUSE uses semantic intersection techniques to 
discern the context of words in the input and to eliminate 
syntactic ambiguities. These techniques have been tested 
in both TLG and MUSE and work for a wide variety of 
sentences, but there still remain problems. Sometimes 
intersections are too powerful and lead to wrong inter- 
PLetaelOns sy) and ssomeuimesmthey sare not strong enough, 
and valid comparisons are not made. The artificial 
limiting of superset chains to three links should be 
removed when conditions are somehow "right" for pro- 
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search of fTLC hes been destroyed in MUSE by directing 
semantic processing using syntax (that is, the model 
examines all possible intersections from one candidate 
combination before proceeding to the next combination). 
Since syntax directed semantic processing is useful in 
cutting down processing time, some compromise will 
probably have to be reached to reinstate more parallel 
Seaccning.. Ferhaps thisscould take =the form of inter— 
secting each candidate combination to only one level of 
superset before proceeding to the next combination. 

If no valid interpretations are obtained after all 
combinations have been tried, the model proceeds to 
the next level of intersection for each candidate com- 
bunatd Om manGecOPOlen inl wom Valdorineerpmetation) 1S 
discovered. 

MUSE answers questions posed in English, but only 
as a by-product of the semantic intersection techniques. 
To expand MUSE into a truly deductive question answer- 
ing system, special routines would have to be designed 
to enable the model to handle questions in a different 
Manner than Other sentences. Thus, it would not be 
dizticult to get the model to search for candidates of 
[WhO me Wwhate fa nWwhetemw, fanaw wien. «with the speciric 
DURPOsemoL TI ndMiGecderect si mamemnory exactly matching 


Liempquestilons "Also, procedures Could easily be defined 
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COBY elma oss ore nogsanswere to, true sor false ques— 
LiLons pesacienmethanwjustyrepeating the question, if it 
Lsetrue. 

TicaMorOmeact ons s(C=Aact1Ons) sinuMUSE enable 
the model to obey orders and perform tasks, something 
which very few non-procedure oriented natural language 
models can do (however, the procedure oriented systems 
O£ such researchers as Woods, 1968; Kellogg, 1968; and 
Kochen, 1969 are based on performing executive routines). 
New, more complex actions could be devised to do such 
EhingseacmrOcgeetLing Concepts, Linding synonyms of 
memory words, or performing intricate deductions from 
input. Potential improvements in existing actions 
range £rom<moditying the output format .of the describe 
action to a complete revamping of the update action 
to allow memory items to be added more quickly. 

MUSMeSeOULDUEECONSistGuOresIMolounng di shetra ples 
which are made a little less readable by the appending 
of numbers to the end (indicating which meaning is 
Meantwinethe current scontext) and by the. printing of 
the intersecting unit-properties from memory. These 
aspects could be eliminated to improve readability. 
The addition of a generative grammar to the model, 
aleuouGg weno Lecumeds yatack, scOuldeimprove Lhe sopnis— 


BUG oivOle Ome we OULU ie 


oes shat: xe ena od eeu “et 49." . 
=i 


ar 3k “AokIeesrp ote phstseqex Jev pei iced 
oat, 


efdcune 220M ai. (etoidose<9) -angliosg season dt 


> 
s@ : 


oa 
prinreroee ,atens mot isq, MGL 213%. 1a) Yaido oj} f a 


spatipy al [saed5a husmeizo siTijbesbortt-Von weal Vaasa 


7 =N : « °  @y CI Aer i -] ° S 
siioveveurhaiisiszo syubs2o tg 8s 4s wor) eb cay Ba 


as 
Pc 


| | | : 
(abqisuort svitcoaxnsa patsmoliieq no. bezsd, stm, "% EL 4 =) 


: . i) 
\ : ; =. 


P : : . ie! ie Se 
dove ob oF pasive: ei BLU GIO Ln ; oe orr S£7Om 4 


< 


7 * r " - 
a) Eamiyi uj ,esgeone é Iapwed Sp 
€ . A, ; - = Pm .% ‘ 
Mt) sO cIvvPesa STB ne Ei Sized vo .aigw 


Sf dan. nisgeize ni edasweavesantc fersinssos , dgnk 


Sadfasdéeb ody to stenao? -arasus. otf only iibon sone sae 


- — 
hor Jyas- 5S iJ nag ‘ fT + 46 bite yey ey ate Fey no” 8 of h?s : : 7 


Viiontam wollte oo 
| : 


Poiatd few Lend SlEmie es. BH PLaiOes -} igi 2' api a 


Pochisqge eft yd-sideheot cael olitil + shemceep ied ce : 


PL prinsem Aoidw mritaoriat) Bas aid 68 eae $5) 
= : + —=8 


y 


70 pattie ett yh bas (txetos snsaai eet mi 


SEIT oe YsOMiam Mort chi troq gn tity unt Seana 
“Ye Fi kanivesss: VO SYNE OF besten Li pe ‘et BLia9, 24 


, viobou sit oF apmmint¢ ovis arbre 1 a ae FER 
i [™ y 
~eitigoe Shi svovgmt Bios: p sfeS Yacee “ne jon a 


eo 


_ 


= aie . 7 = 


et = 


109 


MUSE is very easy to expand. The sample run of 
the last chapter shows how the model learned fourteen 
new words, fifteen new units, eleven new properties, 
and one new parse tree. An improvement on TLC is the 
way that new units are defined only when necessary and 
that all discovered properties and supersets are added 
to old units in memory. In addition, MUSE can learn 
facts not already in memory by creating new properties, 
rather than just by adapting old properties as is done 
in TLC. MUSE can also learn from example and recognize 
paraphrases of old facts in memory. Finally, duplica- 
tLOneOL wOrdcy = UNnltcS, pang) properties is kept. to a 
minimum wherever possible. 

Among the Ce aC features of this learning 
procedure is that new words must be flagged with a 
marker containing a part of speech symbol and any 
associated actions. To eliminate such flagging, the 
model could define a completely new word only when it 
comes across a word not in the dictionary and could 
depinemwas new Unit cOomeaneolaeword only when syntactic 
or semantic procedures break down on all the old units 
for that word. Complex procedures could be developed 
to derive from usage the part of speech of a unit. 
Under this system actions would be associated with the 


parts OL Speech, not the units, so the assigning of a 
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part of speech would also assign an action (naturally, 
tice exc lucaes  C-accions). Thus, a much finer distinc— 
tion between parts of speech would be necessary. 

The way the model discovers relations not yet 
Coded@i nemenonyea Seby tnstackingynearly correctwinter— 
Peete VOodsmr GOMmElomie WlcUmeCIOtemelack mnoOt jaa very 
Sata sractoryemethod. Some sortsof Tecogni tion procedure 
for new concepts must be devised. There is no way of 
adding new actions to MUSE without programming new 
subroutines, although new pointers to existing actions 
can easily be added. It seems unlikely that self 
modifying programs will be possible in the near future, 
SOMUMCwaULONaAtIC oGd lta On OLwace1OnSmisesoMmething) that 
ifs dl duenever Wek Gnive 5 

MUSE is presently programmed in the string mani- 
pulation language SNOBOL4. SNOBOL4 allows the discovery 
Ole pate eticm Ne Liem inpUL,sitaking st Casy tO Lecongize 
Mica vocdsmalime lemMent som NmtLicm Memo byt Les. the 
major problem with the current implementation of SNOBOL4 
Pomel Serco nSe VheTpeciivelVymstlatero melt rtcans lates 
Pacimscatcment wine sbyabine. se This sfactor, when combined 
WithecnesTitLeLactiVemmatuLleron MIS means that. processing 
ie mionny eaves LOW me LiOUCG im Lies prOCccOUbLes OL MUSH @have 
BecimdestgnedelLOusavcecsemuCh  Fime as) possible, there 
are many inefficiencies inethe program atseliz (due to 


PiemcOonVeLrSlOnNOLe the wrogLam to MIS from another’ time 


ids ib 


sharing system, CP/CMs) slowing still further the speed 
of the model. These inefficiencies could be overcome 
by an improved version of SNOBOL4 and a thorough 


revision of the program. 


Conclusion 


MUSE is a natural language model that is based 
SerOrld byeOnw Oui bran tom (1909 jel uC mA tt NOuUg Ha iLs esa imple 
English input is somewhat more restricted than that of 
TLC, MUSE surpasses Quillian's model in many areas, 
especially syntactic processing. MUSE uses a file of 
DoEsemtreesetoule lore liminateecsemanticsembrgulty, ito 
direct semantic processing, and to aid in the derivation 
of new properties. MUSE learns new words and units 
Promo lime discourse through amone Loo) satisfactory 
method of flagging new concepts in the input sentence. 
New properties are derived most often by using syntactic 
PLoceduces sandeasratlecdatrigie stack.) Thecimenony Size 
is kept small by never adding redundant words, units, 
or properties to memory. Syntax oriented executive 
ACLLOnsewhich help thesmocel to imterpret the input 
Fiamma cient kOlLmMecGCIng Om pabaplitases, Can be 
appended to units in memory. In addition, motor actions, 
associated with some memory units, are defined to allow 


MUSE to act on the various interpretations given to the 


12 


imput.. the output FeonsMUSES is simple English tripies 
or predefined English sentences. Implemented on a 

time sharing system, the model interacts with the 
MOnVeO wast ovcs allowing!) hime tovkeep: track sot what is 
going on. Many improvements to MUSE have been suggested 
Pees Chap temsand Lurene rmatesting, wig leslikelysind1— 
cate that still more changes would benefit the model. 
Even as it is presently implemented, however, MUSE 
accomplishes enough to warrant considerable optimism 


FOr) ChemeulL Ure: Ofeconpllbem processinggor, natural language. 
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APPENDIX J! 
SAMPLE PUN 
Potteslicom Memo ny nt | dalp 


#SRUN *SNOBOLE 1=DICTION 2=UFILE 3=PFILE 4=SYNTAX S=WURK3+ 
*MOOURCE*POs7 EI SNUNGQIUL/2)4+*SINK* S=TRCFILE PAR=SIZE=75 
#EXECUTION BEGINS 


CRS YNIAGDIC EERROR CS) GIN SOURCE PROGRAM 


GOOD MORNING. MY NAME IS?)MUSE. 
Sh S Ean Peery OUR SEALE U Te 
1. update syntax. 
THES IN PURPRCANR EES SRNL ERPRETED AS FOLLOWS: 
Serr LRU PUA Veo Dae SRE OPDATERING T )). 
POPS AVAL OP ENTERBRERAT IGN? 
yes 
GOmYrOUSWANT THIS ADDED TOSMEMORY? 


no 

On yOUSWI Stipe OPAGIPs le sPOSSIBLE? 
yes 

SYNTAX UPDATE ENTERED: 

VRE EEN Gio TRARIEIOR. SPEECH VECTOR. 


5 

Mhtsiee PAR OF ~SPEEGHSVECTOR:. 
npvebdmtitc|,ve,npvebdrticj,t,np, 

VRIES PARS Ey. 

Slsacoenv Velez 2 nn lew ol tle hy 25 = 
SYNTAX SUPIDATIET ENT ERED 

Vee N Git Oba AnRIMCOI SPEECH eVEG LOR, 


DO YOU WANT TO CONTINUE UPDATE? 


yes 

DI CitGNn UPDATER ENTERED® 
WRITE WORD. 

meens 


DPC TAONSUPDATE ENTERED: 
WRITE WORD. 


UFILE UPDATE ENTERED. 
WRITE PART OF SPEECH. 


e 
WE EPESAGEIONSS 

Dele 

WRitESSUPERSET. 

u0 

WRITE SUBPROPERTIES. 
po, 

URC ES UPDATES ENTERED, 
WRITER PARTS@OF SPEECH. 


JE 22k 


PFILE UPDATE ENTERED. 

Wiebe lel ReleB Ual Ex 

uld 

WRITE VALUE. 

cilel 

WRITE SUBPROPERTIES. 

po, 

PFILE UPDATE ENTERED. 

WR TES ATER BUTE: 

SYNTAX UPDATE ENTERED. 

Vi ESB NG WHROFSSRART SOF “SPEECH: VECTOR. 
DO YOU WANT TO CONTINUE UPDATE? 

no 

BEBAS Beh PERYOURS UWNPUT. 

muse change diction. 

THE INPUT CAN BE INTERPRETED AS FOLLOWS: 
MUSE1 CHANGE] DICTION1 (SELF1 CHANGEL THINGI ). 
1S THIS A VALID INTERPRETATION? 


yes 

DO YOU WANT THIS ADDED TO MEMORY? 
no 

DOwmNO Uv Sip MEssiOMACT >» 1F POSSIBLE? 
yes 


Uhm ON CHANGE ENTERED: 

EN RERSEEEMENTS WOrmBEe CHANGED: 
meens 

EEN Sei AS aN EEN SU 3:45 

ENTER NEW VERSION. 
emeans;u3h, 

EMBERS ELEMENT TO BE CHANGED. 


UFILE CHANGE ENTERED. 
ENTER ELEMENT TO BE CHANGED. 
u 


ia Saeed enls pC Pr Seepiy D5 .6P 2) 1p] 
ENTER NEW VERSION. 
Ue, aa 0, Pol Dupo fpi2,p1, 
ENTER ELEMENT TO BE CHANGED. 


PELUS CHANGE sENDERED:. 
ENTERMELEMENT \T0 BE CHANGED’. 
p7 

Pip WAS? GP 7iU LOmGd 4 PO, 

ENTER NEW VERSION. 

Bo SO Ua er, 

ENTER ELEMENT TO BE CHANGED. 


DO YOU WANT TO CONTINUE CHANGE? 
no 


Dy i 


PEBAS Pl Y RBEBYOURT LNPWE: 

person change pfile. 

PPAR ANOT SURE BUTS THENKS THAT 

THES | NPURMCANTBETINTERPRETED AS FOLLOWS: 
PERSONDT GHANGEL PEILTERU) 

om thoes VALID SINTER PRETATION? 


MiGES 

DOSYOU WANT THIS ADDED TO MEMORY? 
no 

DOM OUR ISheMeESTORACT 11 F POSSIBLE? 
VICES 


NOPACTIONPPOSSIBLE? 

BEEAS Het VRE eYOURSINPwIx 

at avails equivalent thetr:ad,). 

PAM SNOT SURE BUT Plea UNKSTHAT 

THES DNPUDSCAN Se BEAENTERPRETEDGAS FOLLOWS: 
Bw POGIV ALENT taal HE VG ie 

Lomti tS A VAELDS INTERPRETATION? 


Viers 

DO YOU WANT THIS ADDED TO MEMORY? 
MES 

WO OUSW Sree ONACT el Pe POSSIBLE? 
WES 


PQDIVALENCE DeRiENEDS 

PREAS Eee BYLOURSINPUT. 

chase(v;) means pursue(v;) down(t;) street(n;). 
PeAMenOtesURe BUTS atHINK SHAM 

Ties iN PU RRCANSBEMINTERPRELED AS FOLLOWS: 

CAs RUSE eeu eR SUET MC PURSUETESUPERSEI-UF CHASE! )- 
GAS SUVA eS RE Elle) ie 

Sai ome A EO Here BRE PATRONS 


ves 

DO YOU WANT THIS ADDED TO MEMORY? 
yes 

WOR VUURW io AMERTORACT tPF POSSTBLE? 
yes 


NORAG ON @POSS TERE 

PEBAS ERI) PES LUGE BINPUT 

det inerdog Gnce). 

eave NGnmSoU RESULT ely Ke THAT 

Tee Ne OC ANS EER INTERPRETED AS FOLEOWS: 
SeLEIMDEE UNE DIPOGT OO). 

iS THIS A VALID INTERPRETATION? 


yes 

DO YOU WANT THIS ADDED FO MEMORY? 
yes 

Poe rOUS NSH MES IU SACT? IF POSSIBLE S 
yes 


§HERCUNGEP PONASPBEEN DEFINED. 
PEEASE TYPE YOURS INPUT. 


HO® 


a) 


rutt (ns) ebetdosythat beseanimal(n:). 

IAM NOT SURE BUT | THINK THAT 

THES INPUT CAN BE INTERPRETED AS FOLLOWS: 
RUFF1 BE DOGI (DOG1° SUPERSET-OF RUFFI1 ). 


DOG eS CaANIMA IMEC AN IMAL SUPERSET-CF DOG1 ). 
perio A VARIED INTERPRETATION? 


yes 

DO YOU WANT THIS ADDED TO MEMORY? 
yes 

DOMVOUTN TSH ae TO ACTS 1h POSSIBLE? 
yes 


NOPACTION POSSIBLE. 

PUEASE TYPE YOUR INPUT. 

volkswagen(n;) be car(n;). 

PAM TOT MSURES BUT. teTeliNK THAT 

The SNPUT CAN SBE eR PRET ED AS FOLLOWS: 
VOPR SWAGEN IR BEM CART ECCARL SUPERSET=OF VOUKSWAGENL 
LS: THiS eA VARRDMINTIER PRETATION? 

yes 

DO YOU MANT THIS ADDED TO MEMORY? 

yes 

DOP YOU WISH ME TO TACT, 16 POSSIBLE? 


res 

10 ACTION POSSIBLE. 

PILE ASE 7 YPE YOUR INPUT. 

volkswagen be red, 

[AM NOT SURE BUT 1 THINK THAT 

THE SENPUT CAN BE [INTERPRETED AS FOLLOWS: 
VOUKSWAGENT COLORTAREDI (). 

PoE Se Ae AO NER PRETAT LON ? 


MiGss 

DO YOU WANT THIS ADDED TO MEMORY? 
yes 

DOS OUR Shee 06AC Tal SPUSSIELE ¢ 
MiGs 


MORAG TUONSPOSS PELE. 

PENG Ey Pee CURB NPY. 

ruff chase the red volkswagen down the street. 
[eAM NOTe SUREeBUTs ls THINKaATHAT 

THE INPUT CAN BE INTERPRETED AS FOLLOWS: 
RUG IOCHAS ESN ORKSWAGEN TS (On 

CASES DOWNIE STR ETH je 

VOEKSWAGENL SCOLORIMREDL (): 

Pome ISS AGWVAL POSIT ERIPRETATHON? 

yes 

DOP NOURWANT STHISBADDEDATIO MEMORY? 


yes 
Dom CUS NSieh Ee tOeAGi 7 tr POSSIBLE? 
yes 


MORAC TE ONS POSSIBLE. 
PLEASE Wire eOURe LNPOT. 


Pele 


LZ 


oe 


ine 
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ruff chase the volkswagen fast. 

1 AM NOT SURE BUT | THINK THAT 

THE .1NPUT CAN BE INTERPRETED AS FOLLOWS: 
RUE eRCH ASE WA OUKSWAGEN Iea( )s. 

OnAS Rimes PE RDM GRAS HoMOn 

[fiom HISTA VALIDO INTERPRETATION? 


yes 

DO YOU WANT THIS ADDED TO MEMORY? 
yes 

Dene CUS WiSHeME 1ORAC ere rPCSS BLE? 
yes 


NOSAGHION, POSSLBLE, 

PAU GENS ERGY PEeeyOU RSE NUT 

john(n;) be person. 

[SPO MEENO Tees UR ESSE U Tele eit tsl hem ier AGT. 

THE TEN eU IS CANSSE TENTER PRET aDeASe FOLLOWS: 
JOTINIS BESPERSONISCPERSONT SUPERSET-OF JOHN] ). 
oe TS SAGAVAA ISDS RUNGE EPR Eee TALON» 

yes 

DO YOU WANT THIS ADDED TO MEMORY? 

yes 

DOR GO UWS HM Eee rO PACT, 1h POSSIBLE? 


yes 
NOMAD EO Neer SGii6 LE 

PUBASigeie + Ee BOURS INPUTS 

john have a green volkswagen(n;). 

eM OleeS UR Beeb UTe sl mii THAR 
THESE De CAN TBE TN EER BREED PAS» FOLLOWS : 
JOHNI HAVE1 VOLKSWAGEN2 (). 

VOLKSWAGEN2 COLORT GREENIT (). 

Pome Poe ADIN ER PRE TA I ON? 


yes 

Dene, OURAN T= THiS ADDED] TO MEMORY ? 
yes 

UCM VOUS Wishia MEO shGier lt POSSI BEB? 
yes 


NOMA GIA ON 2205 Silps eee 

PLEAS Hei ee YOUR TEN BRUTE, 

this volkswagen be a car also. 

THEe! MNBUsieGhNwe Ee INTERPRETED “AS FOLLOWS: 

VOLKSWAGEN] BE CARI (CAR1 SUPERSET-OF VOLKSWAGENI ). 
ome Al Sarl WAI DS UNTERPRE TAselON? 

no 

HAO NOT SSURE BUT. I Hi RK THAT 

Tae eh Pu CANB BES ih BRP RET EDRASIEOLLOWS: 

VOLKSWAGEN2 BE CARI (CARI SUPERSET-OF VOLKSWAGEN2 ). 
See esee ey AIBN PEP RETA TElONy? 

yes 

DOM YOUS WANT TLE SAD DED ano: MEMORY ? 


yes 

CUM CUMS el CenOmAC Te" lPe POS od BLE? 
yes 

HORAGTAUGINS POSS | BLE 

Peo tele, GURSIINPUT. 


eee 


Ges 


Lig 


se 


color of the volkswagen be green. 


PAEAENPUIACANTBEVINTERPRETEDSAS FOLLOW 


VOLKSWAGEN2 COLOR] GREEN] (VOLKSWAGEN2 
iSerntiS A VALID INTERPRETATION? 

yes 
DO YOU WANT THIS ADDED TO MEMORY? 
yes 

CORY OUSW TSH MES TORAG SS RePOSS IBLE? 
no 

BEEASE TY PRESYOURSINEUT: 

rover(n;) be another dog. 

ieee NOTeSURESS Une | meileh eer a Ad 


AS 


COLOR1 GREENI 


THESINPOTS CAN BES IMTERPRETED AS FOLLOWS: 
ROVERTSS ERUCG TS (DOCISSUDERSET=-OREROVERI ). 


Serbs PAS VALDES INTERPRE PAT LON? 

yes 

DO YOUGWANT THIS ADDED TO MEMORY? 
yes 

DOSY CUsWISHe ME. [OMAGIS TEe POSS TBEE? 
yes 

NOMAGCHLON @POSSTBLE. 

PEEAS EY PESYGURS ENeUAS 

rover chase the green volkswagen. 


THESE NPUTACANSE EEN LER PR ETED PASy EOREOWS: 
ROVERL CHASEL] VOLKSWAGEN2 (RUFF1 CHASE1 VOLKSWAGENI ). 
VOLKSWAGEN2 COLOR1 GREENI (VOLKSWAGEN2 COLORI1 GREENI ). 


Poa nie VAL LOMIUNT ER ERE TATION? 


yes 

DOR OUR WANT Siri SmeADDEDMTLOR MEMORY ? 
yes 

DOM GO Ua ore EaehOmA Clie FeeeO SS LB LE 
yes 

NOME GeO Mepis lbs 

PEAS Bases yOURSI NPU Te 


john chase dog be. 


| CANNOT INTERPRET THE !{NPUT. 

IAs PROCEEDING. Os LHESNEXT STATEMENT. 
PUEAS Eiby Bey OURS ENPUTS 

halt processing. 


Loew PU CANS EC aaiNG ER PResreD PAS SFOLLOWS: 
Selma Ahir ROCESS iia igeCGBLid  AALT WV tHINGIe ):. 


PSaein om A VAAL DENT Diapers AT LON, 
yes 

DO YOU WANT THIS ADDED TO MEMORY? 
no 

Voge OUR she MES OPAC iCal ES POSS | BEE? 
yes 

THANKS FOR THE CONVERSATION. 
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NORMAL TERMINATION AT LEVEL 0 
CAS Aetna eeXECUTED WAS 339 


SN ODOT ST ATT ST TCS SSUMMARY = 
20961 MS) (COMP EATHIONS T ME 
DAE oe Moree Ai CUT LON TIME 
OO VGI Wea St EARCU TEDy PEOHONER OS  eysMAP bye B) 
POP IME CeO PE RAT TONS PERFORMED 
46639 PATTERN MATCHES PERFORMED 
306 REGENERATIONS OF DYNAMIC STORAGE 


5. oO ugIMS. FAVERAGE. PERS S TAleMENT 


mEXECUTION TERMINATED 
# : 


a7 


Part lis OQuestionmAnswering 
TOP UN SSSNOROWE L=P ICT EONS 2SUP ILE S=PFILE b=SYNTAX S=WURK3+ 
i E 


*NSOURCE*® 6=-LISTING(1,1172)+*SINK* 8=TR PAR=SIZE=75 
#EXECUTION BEGINS 


OUVSYNTAGT IC ERRORCS) TIN ISOURCE PROGRAM 


GOODE MORNING. Se MYERAMEO ISS MUSE 
PUES ere OUR PUT 

ie Care ore ohmebe, green? 
Cet PUTNAM TERI NT eR PRETEDAAS FOLLOWS: 
COINUSTTAY ERY Clk SWAGENDZE JOANIS HAVEL VOLKSWAGEN2 ). 
VOCKSWAGENZNCOUORIMGREENT, (VOLKSWAGEN2 COLOR] GREEN] ). 
[fo TRS AVE D TNGERPRIE TATION? 


yes 

DO YOU WANT THIS ADDED TO MEMORY? 
no 

DO MOU Siege VOT NCT Gs dir” POSS WBE @ 
yes 


THEA NSWE RON TOUR OURSTNION WAS “GIVEN ABQVE. 
PUEBASE TY PERYOURS I NPUTG 

21. who have green volkswagen? 
Thee NU RGA NBER ERPRETED AS FOLEQWS: 
J Ci Re VEY CIGAR SWAGENVIICJCANT “HAVEL VOLKSWAGENZ ). 
VMOLKSMAGENZNICOLORIN GREENTIICVOLKSHAGENZ) COLORI GREENI ). 
SoH SEAG IV AL DIE REPRE PON? 


yes 

DO YOUS WANT: THIS ADDED? TO0*° MEMORY? 
no 

DO MOU MIST Vee OMACTE lit WOSSNS LE? 
yes 


THE ANSWER?) TOP YOUR QUESTION WAS GIVEN ABOVE. 
PISEASESTYPE YOUR VINPUT, 

LEAS rurthiciase! wha tacar? 
Tice Me COANE Gael TER PREED s ASseteOLLOWS: 
RUBE CHASE LIIVOERSWAGENT CROVERIL CHASE] VOLKSWAGEN? ). 
VOLK SWAGENDS GOLORIDREDI (VOLKSWAGEN2 COLORI GREENI ). 
Se THs VA De ERP ReT ANd ON? 
yes 
DO YOU WANT THIS ADDED T0\ MEMORY? 


no 

DOR OUs SH Eee ORG ai sPOSSIUB LE? 

yes 

THEWANSWERD TOR YOURSQUESTIONSWAS® GIVEN ABOVE. 
Mer ASe TY PESYOURMENPUT. 


ZO. 


FANS 


250. 


2.67. 


desen tbe rut fi | 

IP nieNOTe SURES BUTS STHINK THAT 

(ee UPC Vee NT BiPRET ED AS FOLLOWS: 
SEIESL IG INE eae Web) es ahh Re 

IS THIS A VALID INTERPRETATION? 

yes 

DO YOU WANT THIS ADDED TO MEMORY? 
no 

BOe OUR SHeM Pa OP AGT LE POSSIBLE? 
yes 

RURR EEO RE eASUNIT TUN MEMORY: 


LUGE Io ee COGS SeCHUASEI VOEKSWAGENT SPEED] FAST2 


Pec OS eleVOlho WAGE DOWNI STREET IO. .. 
PUEAS Ee YPEs YOURS | NPUT. 

describe chase, 

LAM NOT SURE. BUTEs leetrHINK THAT 

Thee NeUICAN SSE SIN TERPRETED AS FOLLOWS; 
SEURUADES CR RB Een AS be la0()*. 

ESPEn LS ARGV AT Oe ENT ERPRETATION? 

yes 

DOP YOUSWAN TiS MADDEDMFOUMEMORY ? 

no 

DOM OUST SH ee ORACT AE ii POSS TB .LE? 
yes 

CHASE EE ARON IT SENINEMORY,. 

GAS nURSUE lee re VOWNIO STREETIL,. . 
PUEASE—hiPESYGUR AENPUTE 

describe red volkswagen, 

LeAMeNO) SURESBU TR THUNK ATHAT 
THeeNeOle CANS EE INTERPRETED AS FOLLOWS: 
SELP IS DESCRIBEL VOLMSWAGEN LMG) < 

VC RK SWAGENTECOLPOMI MRED I 9G). 

LSetHl SPA SVALUG RI MEERBRETAT TORN? 

yes 

DO CUBV ANTI HiS ADDED TO" MEMORY? 

no 

Von CUMS ater Om lel Ee ePOSS! BLE? 


yes 

VOLKSWAGEN] BE A UNIT !N MEMORY. 

VOLO NAGON Iason eee GOLOR IT eREDL ():. 
PREASE SW PEEWOURRINPUT. 

quit processing. 

THe NPULP GAN @ BE INTERPRETED AS FOLLOWS: 
Selle GEER OGESSUNGleGSELE LT QUITIe THINGL 
Sei Se Ae VAbEDE INI ERPRETATION? 


yes 

DO YOU WANT THIS ADDED TO MEMORY? 
no 

Om CUM Ohm icmiUmAGis bE POSSIBLE? 


yes 
THANKS FOR THE’ CONVERSATION. 
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NORMAL TERMINATION AT LEVEL 0 
LAST STATEMENT EXECUTED WAS 395 


SNOBOL4& STATISTICS SUMMARY- 
ZEGOI MS. COMP ELATION TIME 
Go GO oomus ee eAcGUINION Td MES 
Zt om ALEMENT SE XECUTED? 9305 .FA) LED 
Zoo tear LOM El Ce CO RERATVONSS PERFORMED 
Di OU Sm Ane RN eMAd CHESMPEREORMED 
2 ReReG ENE RATIONS OE DYNAM! CesTURAGE 


oP Omio AVC RAGE: PERSS TATEMENT 


#EXECUTION TERMINATED 
it 


